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Foreword 



In October, 1967, the Center for the Advanced Study of Educational 
Administration (CASEA) and the School of Education at the University 
of Oregon hosted the Seventeenth UCEA Career Development Seminar 
m Portland, Oregon. It might be said that this seminar entitled, “Know- 
edge Production and Utilization: Role Emergence and Reorganization,” 
provided an exploration of one fundamental assumption underlying the 
policies and practices of the University Council for Educational Admin- 
istration since the inception of that organization. This guiding assump- 
tion has been that the practice of educational administration could be 
improved by applying theoretically and empirically supported knowledge 
to problems of educational organization, management, and leadership. 
The history of American education would suggest that knowledge produc- 
tion and the utilization of new knowledge have not universally been con- 
sidered the appropriate and necessary means to improve educational 
practice. As David Clark noted in 1963, “The paths of school improve- 
ment have been directed toward the provision of more of what already 

exists ... and the improvement of practice on the basis of what is already 
known.” 1 3 



This Career Development Seminar was devoted to the presentation and 
discussion of seven papers which examined various facets of prob- 
lems inherent in the application of knowledge to practice. Some of these 
papers view the problems of applying new knowledge to practice quite 
generally in the context of the broader society while others focus more 
sharply on strategies for implementing the utilization of knowledge in 
the context of educational organizations. Throughout the text the authors 
call for the development of new organizations, new roles, and new train- 
ing programs to facilitate research and application of research findings 
m die practice of educational administration. Thus, the papers presented 
at this seminar tend to supply some concrete strategies relevant to the 



David L. Clark, “Educational Research : A National Perspective,” in Educational 
Research: New Perspectives, ed. by Jack A. Culbertson and Stephen Hencley (Dan- 
ville, 111.: Interstate Printers & Publishers, Inc., 1963), p. 8. 
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implementation of a basic organizational goal of UCEA. 

Although a consideration of strategies for the transfer of information 
appears to be the central theme of these papers, no real attempt has been 
made to integrate the papers into a unified document, and inter-relation- 
ships between and among the separate chapters are more implicit than 
explicit. An attempt has been made to order the chapters so that those 
which speak to the problems of knowledge production and utilization in 
a general way precede those.* which explicate more detailed suggestions 
for implementation of new roles and reorganization in education. 

In Chapter 1 , Carter describes four major studies which were con- 
cerned with the steps leading up to the utilization of new developments in 
the military, public welfare, and education. He then considers various 
asp?"ts of information transfer as a national problem, but warns that, 
“While it is important to make the existing knowledge available to poten- 
tial users, we need to recognize that the solution of the pressing problems 
of our complex culture will require much more than the intelligent appli- 
cation of the information and knowledge we currently possess.” Carter 
concludes with seven recommendations about “. . . the proper role of 
knowledge development in our culture.” 

Boyan, in Chapter 2, agrees that the need for improved educational 
development activity is great, but cautions that educational research and 
development should be viewed as a collective concept and enterprise. 
Developmental activity he notes, “. . . creates a voracious demand for 
research output, as well as educational inventiveness. The stronger the 
conjunction in research and development, the more powerful will become 
the combined concept, and the greater the probability of enthusiasm on 
the part of public policy makers for each part of the concept as well as 
the combination.” Boyan traces the history of government support of 
research and development in educational administration and then pro- 
poses a design for the creation of a network of institutions for inquiry, 
development, and the preparation of educational administrators. 

In Chapter 3, Guba cites the lack of a “middleman” role between the 
knowledge producer and the user as a major problem in knowledge utili- 
zation. On the theory to practice continuum, which he describes, the 
activities of the middleman are seen as taking place in the development 
and diffusion stages. The importance of relevant evaluation techniques 
to both development and diffusion activities is stressed. Guba deplores 
the present evaluative methodologies and describes the characteristics of 
a successful evaluation strategy. He concludes that evaluation must be 
continuous throughout the trial period and treatment must be subject to 
continuous improvement in light of the results of evaluative data. 
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Havelock, in Chapter 4, focuses on the linking roles needed to retrieve 
basic or applied knowledge, derive practical implications from it, and 
distribute it to people who need it and can use it. He indicates what types 
of linking roles are most effective for what linking tasks, what character- 
istics and skills need to be considered in recruiting and training linkers, 
and what kinds of institutions need to be created to secure these roles 
and to make knowledge linkage a permanent feature of our national 
educational system. He includes a discussion of the two major problems 
in linking roles, “overload” and “marginality,” and presents a prescrip- 
tion to overcome these problems in education. 

In Chapter 5, Sieber posits four aspects of the public education sys- 
tem which he says distinguish education from other social systems. These 
are vulnerability to the social environment; the professional self-image 
and associated values of educational personnel; the diffuseness of educa- 
tional goals; and the need for coordination and control of the primary 
clientele as well as of the employees of the system. After an analysis of 
these organizational attributes, Sieber outlines existing strategies for 
change and offers an alternative strategy — identified as the Status Occu- 
pant — designed to overcome the difficulties which arise from the domi- 
nant organizational characteristics of education. 

In Chapter 6, Schmuck contends that despite the abundance of re- 
search knowledge available, little of that knowledge seems to influence 
the practice of a large number of school administrators There is, he 
indicates, a need for a new technology of transforming behavioral science 
knowledge into effective practice in educational administration. Schmuck 
then proceeds to deal with one aspect of the technology. He outlines two 
training event models: one whicn focuses on the individual adminis- 
trator’s development and the other which involves the entire faculty of 
a school. Both training events are designed to assist the educator in 
transforming research findings into practical application in schools. 

Goldhammer, in the final chapter, points out that implicit in the call 
for greater knowledge utilization in education is the need for adminis- 
trators who are prepared for specialized roles in the schools. Programs 
for educational administrators must be designed specifically to train the 
educational leaders, the program developers, the diagnosticians, and 
the implementers needed in today’s schools. Goldhammer presents some 
thoughts on how preparatory programs should be revamped to train the 
administrator as “the clinician who can deal effectively with educational 
programs as devised to achieve specific educational objectives.” 
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CHAPTER 

1 



Knowledge Production and 
Utilization in Contemporary 
Organizations 



When I was asked to participate in this s emina r sponsored by the 
University of Oregon and the University Council for Educational Admin- 
istration, I was particularly pleased because the general problem of 
knowledge production and utilization is one of the major concerns facing 
the intellectual com m u n ity. Not only is this a matter of investigation and 
discussion in education but the topic is pervasive throughout the scientific 
and technical world. It is particularly gratifying to be able to participate 
in a seminar devoted to a subject which involves so many people from 
education. In the long run, it is through improvements in the way we 
utilize new knowledge that a more fruitful culture will be developed. I 
have no doubt that those at institutions of higher education will play a 
prominent role in bringing about this rationalization in knowledge 
utilization. 

Perspective on Priorities in 
Research and Development 

Throughout the intellectual and government community there is active 
debate regarding the priorities in allocating this country’s resources. We 

Launor F. Carter is Senior Vice President , System Development Corpo- 
ration, Santa Monica , California. 
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are supporting research and advanced development at a rate of somewhat 
over 15 billion dollars a year. Of this amount about 2 billion is devoted 
to basic research. The national space budget is around 5 billion and the 
sums being spent by the National Institutes of Health are slightly over 1 
billion dollars. While these figures are large, they should be placed in the 
perspective of a gross national product in the order of 800 billion dollars. 
The amount spent on basic science in the United States is approximately 
one-third of one percent of the gross national product. It is argued that 
this is a relatively insignificant figure and that certainly a country of our 
wealth can afford these expenditures in the development of new knowl- 
edge. Yet, when these small pieces are added together, they become large 
and significant. More and more, Congress and the Executive Branch of 
government are asking about the proper priorities in our national ex- 
penditures in the knowledge production area. 

In a letter to the editor of Science , Professor Weisskopf (1967) of the 
Department of Physics at M.I.T. says: 

The troubles of today are, to a large extent, caused by our insufficient 
efforts to create a society in which more people can partake in a life which 
is worthwhile, interesting, and significant. These efforts would become 
senseless if we begin to sacrifice some of the most active parts of our 
cultural life. In these difficult days, we must, more than ever, continue to 
support all that is positive and valuable in our civilization. 

Interestingly, this statement was made in support of an increase in 
funds being devoted to basic science and, particularly, to the relevancy 
of the development of the new 200 billion electron volt accelerator now 
being authorized by Congress. The statement could have been used 
equally well as the prelude to support almost any worthwhile effort. It 
can be seen that it is not enough to merely cite the proportionately small 
cost, or the contributions to our cultural heritage, in trying to determine 
relative priorities in national spending. Rather, we will have to examine 
the various components of our total national economic budget and make 
a number of firm and rational judgments regarding the relative amount 
that will be spent in the various parts of the scientific and technical world. 
Indeed, various members of Congress have been highly critical of the 
Office of Science and Technology and the National Science Foundation 
for not having any well-stated plan of the priority of national spending 
in science and technology. At the last appropriation hearing, NSF was 
chided for this fact and its Office of Planning and Policy Studies has 
recently undertaken a serious examination of the priority problem. 

But is it not just a question of the relative priorities in supporting basic 
and applied sciences. In addition, there is a question of the balance be- 
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tween the amounts that should be spent in support of basic work, applied 
work, and the utilization of the knowledge that is heing developed. More 
and more we are seeing concern over the extent to which hasic research 
has become a closed system in which new results lead to further questions, 
which then demand renewed or increased attention, which in turn com- 
pletes the cycle of an expanding demand for research support. The prom- 
ised practical utilization of results does not appear with the rapidity or 
clarity that members of the public expect It is pointed out that for a 
number of years the space program has been supported at the 5 billion 
dollar level. Medical research has been supported at a 1 hillion dollar 
level. Atomic energy development has been supported at a several hillion 
dollar level. What has been the result of this support when evaluated in 
terms of practical utilization? 

This topic has been the subject of much discussion and many seminars. 
With greater frequency the question is being asked as to whether the rate 
and size of investment can be justified in terms of national priorities as 
judged by the Administration, by Congress, <md by the public at large. 
Particularly germane to this point is a recent discussion by Greenberg 
(1967) which says: 

Last June Lyndon Johnson wondered aloud about the payoff the public is 
getting from the government investment in basic biomedical research 
(Science, 8 July) and, since scientists are among the more insecurity- 
ridden wards of the Federal Treasury, a shrewd salesman might have 
prospered by offering mourning bands for lab coats. By late August, the 
biomedical gloom was such that NIH called in some 300 of its advisors 
from throughout the country to take home the message that the Adminis- 
tration is not disenchanted with basic research. But panic in the scientific 
enterprise, especially in time of tight budgets, is easier to inspire than 
to quell, and apparently the NIH meeting was not altogether soothing. 
Sensing this, Senator Fred R. Harris (D-Ckla.), chairman of the Senate 
Government Operations Subcommittee on Government Research, decided 
to call a sort of summer conference on biomedical research policies. . . . 

If any themes emerged from among the 29 papers that were presented 
during the conference, they were these: 

1. Federal policymakers recognize the value as well as the peculiar vul- 
nerabilities of basic research, and they want to protect it from severe 
budgetary fluctuations and demands for rapid payoff. 

2. However, the rationale for federal support of biomedical research is 
the prevention and alleviation of suffering, and, therefore, greater atten- 
tion and resources must be devoted to efforts that directly help the sick. 

3. Since resources cannot be obtained for investigating or exploiting 
every reasonable possibility in research and treatment, choices will have 
to be made, and these choices may involve decisions to support applied 
research efforts at the expense, in terms of manpower, facilities, and 
money, of basic research. 



4 Knowledge Production and Utilization 

Technical industry, f ’ .e government community, and universities have 
taken clear note of this concern regarding the extent to which work in 
the basic sciences or in the applied sciences has resulted in payoff to the 
larger community. Many studies have investigated the way in which 
knowledge is transmitted from the scientific community to the technical 
community in the development of new products and techniques. One 
slowly emerging conclusion is that outside of the particular military or 
space activity toward which applied studies are directed, there has been 
relatively little spin-off from the large sums being spent in applied military 
or space research. A recent study sponsored by NASA and done by the 
Denver Research Institute was reported under the title “The Channels 
of Technical Acquisition in Commercial Firms and the NASA Dissemi- 
nation Program.” (Greenberg, 1967a) In this study 62 different firms in 
four industries dealing with the production of electric batteries, printing 
and reproduction, industrial controls, and medical electronics were stu- 
died to determine the extent to which NASA-related technical develop- 
ments had been available and influenced the production of products in 
these companies. Although there was considerable variation among the 
organizations studied, the major conclusion was that few, if any, of them 
are vigorously seeking to directly use the technical and scientific output 
of NASA or the other advanced technology developments being supported 
by the government. This is not an isolated study. The problem is widely 
recognized and is forcing government support agencies to give more 
active concern to the dissemination of newly developed knowledge and 
techniques and also to examine the flow of knowledge and information in 
the cycle from research to development to use. 

From Research to Development to Use 
Revisited 

At the February 1966 meeting of the American Educational Research 
Association I participated in a symposium on the functions and operation 
of the then recently instituted program of Regional Laboratories. At 
that symposium I read a paper titled “From Research to Development to 
Use.” (Carter, 1966) I was surprised at the wide interest shown in the 
paper, and think it would be worthwhile to review here some of the points 
made in it. The original paper contains a description of three different 
major studies concerned with the steps leading up to the utilization of 
new developments. At the time the paper was written, the studies were 
just being completed and final reports are now available. 
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Project Hindsight 

The first study has become known as Project Hindsight. (Sherwin, 
1966, 1967) Since the Department of Defense spends about 1.4 billion 
dollars a year on basic research and exploratory development, it was 
interested in learning to what extent this expenditure contributed to the 
development of new weapons systems and the value which could be placed 
on the improvements resulting from these developments. Twenty different 
weapons systems were examined in detail to determine the various im- 
portant events or specific technological developments which allowed the 
design and production of the new weapon system. Once an event had been 
identified, a team of investigators visited the individuals responsible for 
its perfection and interviewed them intensively regarding the scientific 
or technical origin and the environment surrounding the development of 
the particular event. A summary of the data allows a number of important 
generalizations: 

1. It was found that nine percent of the events could be classified as 
science events while 91 percent were classified as technology events. In 
other words, the new capabilities which allowed for the development of 
these weapon systems derived from technological studies and applications 
rather than from basic science itself. The authors are quick to point out 
that this result does not show that science is unimportant but rather it 
points to the time scale involved in the application of science. They say in 
their report: 

It is clear that, on the 50 year or more time scale, undirected science has 
been of immense value. Without basic physical science we could scarcely 
have had nuclear energy or the electrical industry or modern communi- 
cations or the modern chemical industry. None of our science events could 
have occurred without the use of one or more of the great systematic 
theories — classical mechanics, thermodynamics, electricity and magne- 
tism, relativity and quantum mechanics. These theories also played an 
important role in many of the technology events. If, for example, we 
were to count the number of times that Newton’s laws, Maxwell’s equa- 
tions, or Ohm’s law were used in the systems we studied, the frequencies 
of occurrence would be so high that they would completely overshadow 
any of the recent events we identified. But, however important science 
may be, we suspect its primary impact may be brought to bear not so 
much through the recent, random scraps of new knowledge, as it is 
through the organized "packed-down” thoroughly understood and care- 
fully taught old science. 

This finding leads one to the almost inescapable conclusion that if a 
technical development is to take place and it is limited by current tech- 
nology , then the way to solve the problem is to directly attack it in terms 



6 



Knowledge Production and Utilization 



of the then known science and advanced technology rather than to hope 
that basic science will, in any short time period, provide the new knowl- 
edge required to lead to a successful system development. 

2. Another important finding was that of the various technological 
events — about 95 percent were directly motivated and supported by the 
Department of Defense. That is to say, that almost all of the events con- 
tributing to these weapon systems were developed and refined as a direct 
result of a perceived need in the development of the weapons system or 
similar weapons systems. Only very few events resulted from general 
technical developments or from technical developments outside of the 
weapon system area. This finding indicates that if a particular problem 
area is to be solved, the motivation and support must come from people 
working in that particular area rather than from the hope that spin-off 
from other technological developments will make an important contribu- 
tion. 

3. Another important finding of Project Hindsight concerns the time 
distribution of events. The time from which the development of a partic 
ular weapons system was initiated, to the time at which any of its required 
events became technologically feasible, shows a very wide range. Of the 
700 events studied, the range in time was from 20 years before the weap- 
ons system was started through 10 years after it was started. Most of the 
events occurred before the weapons system was started— -on the average, 
around 5 years before. Even so, many of the events were not available at 
the time a decision was made to proceed with the overall system and had 
to be perfected in parallel with the system development. On the average, 
the delay between the discovery of an event and its application was 9 years 
for science events and 5 years for technology events. This result implies 
that there is a considerable lag between the time that knowledge or a 
technique is developed and the time it is applied. Also, even though all the 
technology is not available at the time a particular system is started, the 
pressure of working on the system and having schedules to meet tends to 
force the development of missing events so that, by and large, a successful 
outcome is achieved. 

I do not have time here to review the many detailed results of Project 
Hindsight but I believe that this is one of the most important studies ever 
undertaken of the process by which knowledge is put to use. The study 
indicates clearly that an orderly process from research to development 
to use is largely a myth and that, in fact, there is a great deal of crossing 
back and forth in terms of the development cycle, in terms of funding, 
and in terms of the people involved. 
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A esse study of a successful development project but 
unsuccessful diffusion of the techniques developed 

Edward Glaser’s Human Interaction Research Institute (1967) has 
completed an interesting study for the Vocational Rehabilitation Admin- 
istration. In this study they examined the factors which seem to have in- 
hibited a number of vocational rehabilitation agencies from adopting the 
techniques and methods of a successful demonstration by the Tacoma 
Goodwill Industries in a project titled “‘The Development of an Occupa- 
tional Evaluation and Training Center for the Mentally Retarded” (Vo- 
cational Rehabilitation Administration 308). The objective of the Ta- 
coma Project was to demonstrate the feasibility of rehabilitating severely 
retarded young adults to a level of sustained employment. The popula- 
tion consisted of young adults between 16 and 30 who had measured IQ’s 
between 50 and 75. In addition to vocational training, the workshop em- 
phasized training in work habits and in the various attitudinal and per- 
formance characteristics which would mdfco these people acceptable to 
employers. A team consisting of a psychiatrist, a psychologist, a nurse, a 
social worker, and a vocational specialist worked with the individuals 
trying to impart the necessary skills. As a result of this effort, 63 percent 
of the subjects were placed in jobs, with each person remaining on the 
j ob for a min imum of three months. Some of the individuals were retained 
in sheltered workshops but many were placed in competitive employment 
in janitorial, domestic, factory, and farm settings. Although the original 
project was sponsored by federal funds, the Tacoma Goodwill organiza- 
tion has been able to continue this work under local auspices. This study 
was completed in June of 1963, and the results were communicated 
through formal reports to VRA and distributed to a number of rehabilita- 
tion agencies. However, despite the successful demonstration by the Ta- 
coma Goodwill Industries, no other organization was known to have 
adopted the procedures used. 

Glaser and his associates studied the efficiency of various methods of 
co mm u n icating the results of this study. As a first step, a questionnaire 
was sent to 40 widely separate VRA-sponsored occupational training cen- 
ters for the mentally retarded inquiring whether or not they were aware 
of the study and its results. Since very few knew of the study, they were 
sent reports and a special brochure on the study. As a second communica- 
tion step, a representative of the Tacoma workshop visited a selected 
sample of agencies in the California area to communicate the Tacoma 
results to them. As a third technique, a conference and dem ons tration for 
33 representatives of workshops was held in the State of Washington. In 
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addition to the representatives themselves, consultants from Human Inter- 
action Research Institute, the VRA, Tacoma Goodwill, and the University 
of Washington participated in a discussion of the Tacoma Goodwill proj- 
ect. A fourth communication method involved direct psychological con- 
sultation to the management of various workshops. It was hypothesized 
that when an organization becomes involved in a self-examination of its 
goals, opportunities, ways of operating and its problems, it would tend to 
seek new ways to reach those goals. If a skillful psychological consultant 
were available to management, it seemed probable that the organization 
would be led to change more rapidly. To evaluate this hypothesis, a psy- 
chological consultant was made available for 15 day-long visits over a 
period of six months to each of five workshops. 

As reported by Glaser and his associates, the major results of this in- 
vestigation were as follows: 

1. If promising research or demonstration findings are reported in easily 
readable, brief and non-technical form, and are widely distributed to 
potential users, the chances of their having impact and being used will 
be increased relative to reporting by a formal report. 

2. If potential users of the research or demonstration attend a conference 
where they can discuss the innovation and see it in operation by a site 
visit, use of the innovative research or demonstration is significantly 
facilitated, especially if there also is an opportunity for the conferees to 
tell each other about their own innovative programs or practices. 

3. If rehabilitation workers who have heard about and seen an innovative 
demonstration elsewhere are later visited in their own agency by a member 
of the demonstration project staff, that added increment of face-to-face 
communication on one’s own premises and with one’s own working group 
further promotes the use of the innovation. 

4. Psychological consultation to management helps the organization 
change more rapidly and become more open to change. 

A traveling seminar and conference for the 
implementation of educational innovation 

The System Development Corporation was interested in testing the 
feasibility of conducting traveling seminars and conferences as a tech- 
nique for increasing innovation in education. This program, supported 
by the U.S. Office of Education, has been described by Malcolm Richland 
(1965) under the title “Traveling Seminar and Conference for the Imple- 
mentation of Educational Innovation.” While Mr. Richland authored the 
report, a large number of people at SDC were involved both in conducting 
the seminar and conference and in evaluating the results. Much of the 
following material is quoted or paraphrased from the report. 
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The project had four major objectives as follows: 

1. To conduct a survey of, and visitations to, school sites with outstanding 
innovations. 

2. To implement and conduct a traveling seminar of some 120 educators 
to selected innovating school districts in four regions of the United States. 

3. To conduct a conference on the problems of implementing tested 
innovations. 

4. To perform research related to the testing of the field extension service 
concept in education. 

Principal activities of the project included a traveling seminar in which 
four groups of approximately 30 educators each, representing four regions 
of the United States, visited selected schools where significant innovations 
had been introduced and in operation for at least one year. Immediately 
following the seminar, a conference of tour participants was conducted 
at SDC on the dynamics of educational change; approximately one year 
later, on-site visitations to the participants’ own schools were implement- 
ed. The school visitation sites were analogous to the demonstration centers 
inherent in the field extension concept of the Department of Agriculture. 
Each tour was led by a well-known and respected educator (“outside 
change agent”) , who was accepted by his professional colleagues as being 
especially qualified to interpret the experimental foundations upon which 
a particular innovation was based, if such foundations were, in fact, 
offered by the innovator. 

These four tour leaders were responsible for conducting the tour, were 
involved in the selection of the sites to be visited by the traveling seminar, 
and made all the arrangements for the visits to the schools, including 
advance briefings to the officials of the schools involved. 

The schools selected for visitation were ones that had successfully im- 
plemented various educational innovations. The emphasis was on new 
educational media, major changes in curriculum, innovative t u bing 
methods, and new school organizational patterns involving the use of 
teachers’ time and classroom space. The schools selected also represented 
different sizes and urban-rural characteristics in the geographic region. 
Each of the schools visited had at least one year’s experience with the 
particular educational innovation involved. To give a feeling for the kinds 
of innovations observed, the eastern tour, visiting one school in Massa- 
chusetts and two in New York, was exposed to the following: Continuous 
Progress Plan; Lay Personnel on Teaching Staff ; New Vocational Train- 
ing Plan for Culturally Disadvantaged Students; New Curriculum Mate- 
rials; Auto -Instructional Devices for Individual Study; and Flexible 
Scheduling. 

The tour participants formed a somewhat heterogeneous group. A 
number of studies have shown the importance of the school superintend- 
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ent and the need for positive and effective leadership at this level. In ad- 
dition, the representatives of the various formal echelons of education 
are important and their concurrence is often needed in effecting innova- 
tions. Therefore, the final composition of each tour group included 15 
local administrators, 8 state education department officials, and 7 repre- 
sentatives from teacher training institutions. The tour itself lasted one 
week. Each group met on Monday of the week of May 11, 1964, was 
briefed by the tour leader, and then began the site visits. At the site they 
observed a particular innovation and discussed its advantages and prob- 
lems with the teaching and administrative personnel. The team often met 
among themselves to discuss further the particular activity observed and 
then moved to the next site. The complete tour involved visiting at least 
three different schools in separate geographic locations. 

Following the tour, the tour members came to Santa Monica for a con- 
ference on May 16 through May 19, 1964. This conference was attended 
by the tour leaders, the tour participants, and selected consultants and 
specialists from SDC. At the conference each of the tour dir ectors gave a 
fairly extensive description of the innovations observed by each team, 
as well as a summarizing report of the problems associated with the in- 
novations observed. In addition, there were various addresses by leaders 
in the field of education and people who had studied problems associated 
with the introduction of change within various organizations. 

Although the participants in the seminar expressed great enthusiasm 
for the traveling seminar as a technique for observing innovations and 
for stimulating participants to try such innovations in their own school 
setting, a more careful evaluation of the results seemed desirable. This 
evaluation consisted of two parts. One was assessment of a large amount 
of anecdotal material, letters, discussions, etc. The easiest way to sum, 
marize this material, which is discussed at considerable length in the 
report, is to say that the participants seemed to be extremely pleased with 
the progiam, and expressed plans to attempt many innovations in their 
own school settings. 

The second effort was to undertake a formal evaluation of the effects of 
the program. In this evaluation, 46 of the 60 participating school districts 
were used as the experimental group and 57 comparable districts formed 
a control group. Prior to the initiation of the tours, the superintendents 
of schools in both the experimental and control groups hed filled out a 
detailed questionnaire concerning the nature of educational innovations 
in their districts. Approximately a year later each superintendent was 
visited, and participated in s structured interview regarding the school 
district and its innovations. Following the interview, the questionnaire 
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and interview material were assessed by SDC staff personnel, and degree 
of innovation was scaled on a 0 to 4 scale. Participating districts had a 
higher innovation score than did the nonparticipating districts. This 
change score was evaluated by analysis of covariance with the results 
being significant at past the .01 level of confidence. 

A study of translating laboratory research in 
learning to operational settings 

Since my earlier paper, Mackie and Christensen (1967) have published 
a report which is particularly relevant to education. This study was 
undertaken to describe the processes involved in translating the results 
of laboratory research in psychology into forms that would be meaning* 
ful and useful in operational settings. The investigation concentrated on 
experimental studies of the learning process, because of its obvious im- 
portance. In this investigation, selected studies of human learning were 
analyzed in detail and their findings were reviewed for possible practical 
application in Navy training. Also, the apparent impact of the findings 
of these studies on actual Navy training personnel and training practices 
were studied. Additionally, a number of well-known psychologists in the 
field of learning, in educational psychology, and in positions of responsi- 
bility for research on training were interviewed on issues that were con- 
sidered vital to the translatability and applicability of research results. 
In reporting their findings, Christensen and Mackie say: 

It was found that the research-to-ap plication process never has properly 
developed for the psychology of learning. Consequently, there have been 
far fewer applications and much less impact on the educational process 
than might reasonably be expected in view of the size of the lear nin g 
research effort. The reasons are believed traceable, in large part, to the 
research philosophies of experimental psychologists. But it was evident, 
also, that potential users have been reluctant to make the effort necessary 
to realize the benefits of research finding s . . . 

Research on learning processes represents, perhaps the largest single 
area of investigation presently being pursued by experimental psycholo- 
gists. Although this has been true for some time, there has been no syste- 
matic effort directed toward practical application of the findings from 
learning research. As a consequence, modem learain j research is produc- 
ing very little impact on educational technology or training practice. 

Some will think that the above quotation represents too harsh an eval- 
uation of the results of years of experimentation in the psychology of 
learning. One can speculate what conclusion would be drawn from a 
similar study from various other fields in psychology and education. I 
suspect that a careful examination would show that much of the research 
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done in these areas has resulted in only fairly limited application in real 
life situations. It seems probable that the recognition of this fact was an 
important stimulus to the U.S. Office of Education in establishing the 
research and development centers and the regional laboratories. It is my 
belief that a successful program in the area of education will result only 
from very extensive and lengthy work on the part of these research and 
development agencies in intimate involvement vrith actual school experi- 
ence in real-life school situations. 

The four studies reported in this section have each contained many find- 
ings and recommendations. Although they come from different fields (the 
military, the welfare field, and education) their conclusions and results 
have a common core of implication for knowledge dissemination and the 
utilization of research. These broader implications will be considered in 
the final section of this paper, but first I want to discuss the information 
transfer problem. 

Information Transfer as a National Problem 

There has been increasing concern regarding the formal aspect j of the 
information transfer problem. The results of basic and applied research 
and technological innovation are reported in numerous documents, jour- 
nal articles, government reports, books, etc. The numher of these and the 
difficulties in making them available for use have been increasing for 
years. This has been recognized at the federal level by a number of agen- 
cies. The National Science Foundation has established an Office of Science 
Information Services which has associated with it a Science Information 
Council. Also, the federal Council for Science and Technology has estab- 
lished a committee known as COSATI, the Committee on Scientific and 
Technical Information. Finally, within the last year, the President has 
appointed a National Advisory Commission on Libraries. 

Two years ago I was fortunate enough to head an SDC team which had 
been commissioned by COSATI to undertake a study of the national prob- 
lems in scientific and technical document handling. The results of the 
study have recently been reported in a book. (Carter et al., 1967 ) Within 
the limitations of this paper, I can do no more than give a quick synopsis 
of the book and hope that those interested in the total national scientific 
and technical document handling problem will be stimulated to read the 
entire book. 

The first part of the book describes the present document handling 
system. There are chapters on document handling institutions, on the 
process of document flow and on document users. Another section is 
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devoted to a statement of some of the fundamental problems in document 
handling and the formulation of basic propositions regarding federal 
responsibility in this area. The next section develops various alternative 
approaches to solving the problems set forth in previous chapters and the 
final section evaluates the various alternatives and makes prognoses re* 
garding future actions. 

It is argued in the boc ; that information is one of our most precious 
national resources. The information problem is much more than the local 
annoyances, inconveniences, and dissatisfactions with document informa- 
tion systems. It is argued that a natural resource such as knowledge and 
information is something with which the Federal Government must be 
vitally concerned and that it needs to guide the overall development and 
conservation of such an asset. From this perspective, the various problems 
currently facing the national document handling system are reviewed. 
Among the problems discussed are: 

1. There is a need for the adoption of a fundamental statement of policy 
on the part of the Federal Government. It is suggested as a fundamental 
proposition that the Federal Government has the responsibility to assure 
that there exists within the United States at least one accessible copy 
of each significant publication of the worldwide scientific and technical 
literature. 

2. There is a great increase taking place in the number of users and user 
requirements. It has been estimated, for example, that there will be about 
a 50 percent increase in the number of scientists and technologists in 
the next five years. It is estimated that there will be four million scientists 
and technologists by 1970, at which time they will represent 4.7 percent 
of the total work force. 

3. A serious problem is the rapid increase in the number of documents. 
The number of books, journals, etc. doubles almost every 15 years. Foi 
example, it is estimated that in 1961 there were 658,000 technical docu- 
ments published and that by 1970 this number will grow to 1,143,000. 

4. Another problem is that the present system for handling formal docu- 
ments is in serious trouble in its effort to render quality service. There are 
a number of evidences of this difficulty. For instance, the Library of Con- 
gress is having to greatly increase its bibliographic service to libraries, 
but even so only 50 percent of the various catalog cards required are 
available to major research libraries. Some libraries have large backlogs 
of documents and books which they are unable to process into their col- 
lections. Although libraries want to give service to all legitimate user, 
many are adopting restrictive policies regarding the services they render. 
The amount of trained manpower in the library field is far short of the 
demand and is not growing at as fast a rate as the growth of the general 
professional work force. Likewise, the budgetary situation for most re- 
search libraries is critical. Public libraries and school libraries are cur- 
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tailing services and stinting on staff because they cannot raise the money 
to maintain a desirable level of service# 

5. Libraries have been very slow to adopt modern technology and com- 
puter techniques. 

6. At present, the system of document handling institutions is composed 
of many independent units within the government, at universities, in pro- 
fessional societies, as private efforts, and in industry. These units have 
tended to go their separate ways in terms of local plans and resources. The 
need for an integrated long-range plan has only very recently been recog- 
nized and hopefully will be one of the outcomes of the rftnnmmpndationg 
of the National Advisory Commission on Libraries. 

In view of the many problems just summarized, the study team re- 
viewed the various plans which had previously been proposed for national 
document handling systems. Three new major organizational concepts 
were developed and evaluated at considerable length. One of these in- 
volved establishing within the Executive Branch of the government a 
capping agency which would set general policy and monitor the perform- 
ance of various responsible agents— agents who would be directly in- 
volved in the operation of the many facets of a national scientific and 
technical document handling system. 

As a result of the COSATI study and studies undertaken by the library 
community and other portions of the Federal Government, the President, 
® January, 1967, appomted a National Advisory Commission on Librar- 
ies. As a member of the Commission, I have been privileged to meet with 
the other members of the Commission, who represent a very broad spec- 
trum of those concerned with the library and information transfer prob- 
lem. There are representatives from major universities, from research 
libraries, from state libraries, from public libraries, from school libraries, 
from law libraries, and medical libraries. In addition, there are represent- 
atives from major learned societies, and from the lay public interested in 
library problems. In addition, a former Congressman who was instru- 
mental in the passage of the Library Construction and Service Act is a 
member. It would be inappropriate to discuss possible recommendations 
before the Commission’s report is made to the President. I can say, how- 
ever, that the Commission has made an effort to tap all available sources 
of information. It has heard representatives from all the major profes- 
sional associations concerned with libraries a** 4 document handling. It 
has visited some of the nation’s leading libraries and has held hearings in 
a broad sample of localities throughout the nation. We are just now in 
the process of formulating our recommendations. 

Even though many groups are working on the problem facing the for- 
mal information transfer mechanisms, it seems probable that even if they 
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were successful, we would still be faced with serious difficulty in imple- 
menting the knowledge which has been gained. Frequently, the knowledge 
available in reports is not easily translatable into practical application. 
Often the carefully reported results are so narrowly restrained or so con- 
fined to the laboratory setting that their implications for real problems 
are, at best, tenuous. While it is important to make the existing knowledge 
available to potential users, we need to recognize that the solution of the 
pressing problems of our complex culture will require much more than 
the intelligent application of the information and knowledge we currently 
possess. 



Using Knowledge in Attacking Major 
Contemporary Problems 

In this paper we first discussed the question of priorities in research 
and development and their place in the national scene. Second, we de- 
scribed four studies dealing with the problem of research to development 
to use. Third, we considered various aspects of information transfer as a 
national problem. Now, I wish to draw together these separate sections 
and to consider some new material which should give insight into the 
way? in which knowledge can be used in attacking some of the major 
contemporary problems facing our civilization. Many will not agree with 
the comments I am about to make. I hope that by stating some fairly 
dogmatic positions, I can stimulate discussion of these important prob- 
lems and help those who disagree with the positions I have taken to 
examine the basis for their position. Thus, we can come to some agreed 
upon conclusions or directions for solution of the proper role of knowl- 
edge development in our culture. The points I wish to emphasize are : 

Seek the solution within the context of the problem. 

If a major problem area needs attacking, then the solution should be 
sought by work within the context of the problem area itself rather than 
hoping that knowledge developed in basic research or in other applied 
areas will have great application to the particular problem needing solu- 
tion. This conclusion tends to place basic scientific research in a less 
central position than is often done in discussing ways of solving major 
problems. Although basic research and scientific theory remain funda- 
mental ingredients to solving problems, the knowledge derived from basic 
research tends to be too general to guide the way for the solution of 
specific cortemporary problems. This conclusion is borne out by Project 
Hindsight and the Mackie and Christensen study. 
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The solution to contemporary social problems 
will be complex and many faceted. 

Simple solutions are extremely unlikely. If there were simple solutions 
to the various problems we are facing today, the problems would have 
ceased to exist long ago. Rather, these problems persist in spite of the 
efforts to apply common sense and straightforward approaches. All our 
experience shows that the solution to major system problems involves the 
application of many different developments and their integration into a 
concentrated attack on the problem. Again, one can cite the Hindsight 
experience where it was shown that the development of a major new 
weapons system depended on the solution to a large number of relatively 
well defined, small, but critical problems. Similar results can be cited 
from other fields. One of the great successes in America has been the 
revolution in agriculture. Recently, Sprague ( 1967 ) has reviewed the 
conditions necessary for agricultural production in the developing coun- 
tries. He emphasizes the many factors which are essential for the success- 
ful introduction of high-yield crops. After reviewing the increase in rice 
production in Japan, he says: “As is typically the case, this increase in 
yield is the result of many factors: improvement in varieties, increased 
use of fertilizer, modification of cultural and production practices, and 
better control of disease, insect pests and weeds.” 

Certain critical conditions are essential for the 
successful attack on any major problem. 

Prominent among these critical conditions are: First, there must be 
an appropriate acceptance and motivation on the part of the community, 
the government and other involved agencies in recognizing the need for a 
concentrated effort toward solving the problem under consideration. 
Second, there must be a trained, motivated and experienced staff avail- 
able for long-term application to the problem. Generally, the problem will 
not be solved in any short period of time and those responsible must 
recognize that the same staff must be maintained over a number of years 
if the problem is to receive real attention and solution. Third, funding 
must be available not only to support the staff but often to male* many 
physical and organizational changes within the setting in which the prob- 
lem exists. 

The concept of assessment is fundamental to 
solving significant problems. 

It is surprising how frequently we resist the idea of assessment. We will 
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deplore some existing condition or state that a serious problem exists 
without being willing to undertake the necessary effort or even to recog- 
nize the necessity for a quantitative assessment of the existing situation. 
Further, such assessments must be based on rigorous and objective tech- 
niques. In weapons system development, specifications are worked out in 
great detail which define the various parameters which must be satisfied 
before the weapons system will be considered satisfactory. These specifi- 
cations are clearly understood by the developer and the user. At times, 
almost as much money is spent in evaluating and assessing the weapons 
system as went into its original development. Frequently, modifications 
and continued development are required if deficiencies in the original 
design are demonstrated during the assessment phase. Similarly, we 
should not be satisfied with introducing ameliorative efforts in the social 
and educational areas unless we are willing to undergo the stringent test 
of objective assessment so that an evaluation of the effectiveness of new 
methods can be made and cost/effectiveness estimates derived. 

A new profession of social or educational engineering 
needs to be developed. 

In evaluating contemporary problems in education and the social area 
generally, it seems there is a wide separation between the practitioners in 
these fields and those engaged in research in our academic institutions. 
We do not have the middleman who, as in the case of the engineer, is 
devoted to solving specific problems. The engineer takes accumulated 
experience in technology and general principles of basic science and 
applies them to the solution of problems. His orientation is towards 
neither the development of basic new science nor the operation of a par- 
ticular system but rather that of the designer, architect, and introducer 
of the new system. Such people are lacking in the education and social 
fields. The universities and government must take the initiative towards 
defining this new profession and training the people who will become its 
practitioners. Since contemporary social problems largely arise in the 
sector where government is primarily involved, that is to say, problems 
in education or in urban development or in environmental control, where 
there is a clear recognition of government responsibility, the social engi- 
neer needs to be trained to serve within a government-oriented context. 
Thus, the government, if we wish it to deal adequately with these prob- 
lems, will need to encourage over a long period of time the training and 
employment of people in this new profession. 
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Simple solutions and instant experts 
are counter-productive. 

It is my impression that there are still a large number of well-educated 
people who feel that somehow a simple solution can be found to most of 
our problems. Often these same people believe that if a good sensible 
person would just look into the problem for a short period, he would be 
able tc perceive what needs to be done. A striking example of this phe- 
nomenon is the number of people who believe they are experts in the area 
of education and believe they know what should be done. In a recent i p sue 
of the New Republic , Joseph Alsop (1967) authored an article titled ‘ No 
More Nonsense About Ghetto education.” On the basis of his short 
acquaintance with this subject, Alsop advocated that “brilliant Negro 
achievement” could be realized if the education world would only adopt 
New York City’s “More Effective Schools” program. For those who are 
unfamiliar with educational developments, Alsop’s article probably car- 
ned great conviction and no doubt led many to believe that here we had 
an example of the wise man coming up with a sound solution. It was with 
real pleasure that I read a reply by Schwartz, Pettigrew, and Smith 
(1967) in a subsequent issue of the New Republic titled “Fake Panacea 
for Ghetto Education.” These Harvard educators were able to show the 
misinformation contained in Alsop’s article, his rejection of much perti- 
nent information, and his relative ignorance of developments in the prob- 
lems of ghetto education. Yet, I ventuie that Alsop, because of his wide 
reputation as a syndicated columnist, has influenced many more people 
than the reply by the group of experts in the subject. 

One long-range approach to this problem suggest! that educators have 
a special responsibility to transmit an understanding of our contemporary 
problems in such a way as to insure that college graduates are reasonably 
immune to the idea that simple common sense solutions are the answers 
to most of our contemporary problems. 

A special problem exists because of the nature of the 
gatekeeper in contemporary problem areas. 

By gatekeeper, I mean the individuals and organizations which are 
essential to the solution of contemporary problems because of their 
strategic location in approving or disapproving particular solutions for 
these problems. I have in mind such gatekeepers as school boards, legis- 
latures, city councils, planning commissions, etc. In the development of 
weapons systems, we have quite clearly defined gatekeepers. One of Mr. 
McNamara’* great achievements has been his ability to establish respon- 
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sibility within the military services for clear decision-making and clear 
lines of authority as to whether or not a particular weapons system will 
be developed. Once the decision has been made to proceed with the de- 
velopment of a weapons system, the necessary budgeting, development 
plan, personnel allocation, industrial contracts, etc., follow. In these de- 
velopments, the location of the gatekeeper is clear but, more importantly, 
the gatekeeper has a professional expertise in the subject about which 
decisions are being made. This may be a military professional back- 
ground, a highly technical engineering or science background, or other 
background which is appropriate to the particular problem. In marked 
contrast, we often find that in contemporary educational and social prob- 
lems the gatekeeper is not well defined. It is unclear exactly what body 
or institution is responsible for making a decision. Likewise, the person 
filling the gatekeeper role often does not have the technical or expert 
knowledge necessary to make the decision. Too frequently the gatekeeper 
in the education and social area occupies his position because of ability 
to win elections, general social affability, or business interest rather than 
a trained professional expertise in the problem under consideration. I do 
not suggest any simple solution to this problem but as time goes on we 
will have to try to better educate or to change the role of these gatekeepers. 

In conclusion, then, I would suggest that this seminar serves a most 
useful purpose in focusing the highly important task of developing strate- 
gies for solving the many contemporary problems which our nation faces. 
It seems apparent that the utilization of knowledge is one of the important 
ingredients in coping with contemporary problems, but much more is 
involved. The whole problem of a strategy for change and the method of 
bringing together the necessary resources deserves our most serious 
attention. 
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CHAPTER 

2 



Problems and Issues of 
Knowledge Production 
and Utilization 



The juxtaposition of the terms production and utilization signifies that 
the central issue is improvement of the relationship between the two do- 
mains. The central problem is how to improve the relationship. These 
two propositions hold however we define knowledge, production, or 
utilization. They hold also whether we focus on education, on administra- 
tion, or on educational administration. 

What we mean by new knowledge requires clarification. Do we mean 
only the product of rigorous scientific inquiry, including humanistic, 
historical, and literary scholarship? Or, do we mean also the full range 
of innovative ideas that are untested and unevaluated? If we restrict our- 
selves to the narrower definition, we would deal literally with the relation- 
ship between research and practice. If we employ a broader definition, we 
would deal as well with the larger question of the openness of education 
to change in practice, irrespective of the demonstrated validity of im- 
provement of practice attributed to or claimed for the change. 

One way to encompass educational inventiveness with the product of 
inquiry is to treat them both as domains of hypotheses that require rigor- 
ous testing for their claimed contribution to improved practice. The 
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products of educational inventiveness and of rigorous inquiry tend to 
share at least three elements in common. First, they appear in an unde- 
veloped state. Second, they appear in forms which are not fully understood 
by and acceptable to potential users. Third, they seldom include specific 
provision for preparing or training the potential user to use the product 
wisely and well. These three elements constitute essential links in the 
relationship of the production and utilization of knowledge, narrowly or 
broadly conceived. 

Recognition of the linkage problem is long standing. Students of the 
adoption and diffusion processes have offered over the years a number 
of hypotheses and findings about factors that influence the introduction 
and spread of innovations in educational institutions. Their essays and 
studies treat a wide range of independent variables. Most observers have 
restricted themselves to analysis of variability in factors which have been 
present. Only a few observers have asked whether essential elements may 
have been missing. The question of what is missing in the total process of 
converting knowledge into practice has turned attention to the potential 
power of educational research and development as a collective concept 
and enterprise. 



Educational Development 

The concept of development as an activity of great magnitude and great 
consequence has taken root slowly in education. There exists a relatively 
shallow and narrow base of tradition on which to build in attempts to 
invoke the concept and to give it body. 

Examples of near fit include features of the major curriculum programs 
in the sciences and in mathematics that blossomed in the late 1950’s and 
of scattered efforts in the field of structural innovation, such as the Flex- 
ible Scheduling Project at Stanford University. These examples share in 
common the goal of making educational ideas and inventions work. The 
developers in each instance assumed the responsibility for carrying their 
ideas to the drawing board to create specific materials and processes, 
taking them from the drawing board to the field for tryout, returning to 
the drawing board with the results of their field testing, returning to the 
field with more refined materials and processes, again and again. This 
iterative process both characterizes and constitutes an essential feature of 
developmental work. 

In addition, these examples share in common the creation of multi- 
disciplinary teams, who contributed over time and in concert the power 
of their expertise to the development of the new materials and processes. 
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These teams also attempted systematic assessment of the intended effect of 
the new materials and the new procedures, formatively and summatively. 

Carefully designed and executed iterative work distinguishes rigorous 
developmental effort from the act of “selling” new materials and new 
processes to schools before they are appropriately field tested and before 
they are installed in pilot schools for additional reality testing and feed- 
back. Educational development is a slow, demanding, exacting and ex- 
tremely expensive process. It requires a multi-disciplinary assembly of 
talent, properly rewarded for devoting it .self to this slow and demanding 
activity. It, therefore, must find a home and a base that will provide the 
climate, the tools, and the rewards necessary to sustain the effort. 

The financial support and the hospitable climate for development in 
education have been marked more by their absence than their presence. 
The conventional curriculum-building exercises of local and state school 
systems, and the conventional preparation of texts and materials, hardly 
qualify as development work of significance when placed along side of 
the efforts of the Physical Sciences Study Committee or the School Mathe- 
matics Study Group. 

Since educators have rarely understood the importance of educational 
development in converting knowledge into practice and since they have 
rarely appreciated its complexity and sophistication, they have never 
really supported it enthusiastically, either outside or inside of the institu- 
tions that have conventionally housed the educational enterprise. 

As a result, the state of the art of educational development is low. Yet, 
it is hypothesized that the relationship between the production and utiliza- 
tion of new knowledge in education will be materially strengthened only 
when educational development emerges as a well supported and highly 
rewarded domain of activity. At this point in time, however, it is still a 
hypothesis rather than demonstrated fact that educational development 
is the keystone in the relationship. Rival hypotheses need to be constructed 
and tested before one draws too strong an inference from scanty data 
about the power of development as an explanatory variable. The con- 
nection between production and utilization is complex and requires analy- 
sis of a style and character in keeping with the territory. More than likely, 
multivariate type analysis is needed to help explain and to understand the 
relative contribution of several factors in improving the relationship. 
Probably no one factor can explain enough of the variance in enough 
cases to permit a single, simple-minded inference. 

Nevertheless, observation of what has occurred in instances where 
serious, sophisticated, and extensive developmental work characterized 
the introduction of a tested innovation strongly suggests that educational 
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development is a necessary, if not sufficient, condition to improving the 
relationship between the production and utilization of new knowledge. 
The relative rates and scope in the adoption and diffusion of the “‘new” 
mathematics and science, as compared to other content and structural 
innovation, represent cases in point. 

As an activity in its own right, development can build both on a base 
of educational inventiveness, or hunches, and on the foundations of 
earlier, rigorous inquiry or scholarship. This inventiveness, these hunches, 
and imaginative ideas also constitute part of the storehouse of knowledge, 
broadly defined. Even so, research capital and competence, narrowly de- 
fined, constitute essential pillars on which to rest a dominant portion of 
serious developmental work. It is in this sense that the notion of educa- 
tional research and development, collectively considered, is likely to 
emerge most powerfully, assuming that the developments appear in forms 
that are understood by and acceptable to intended users and that the users 
are specifically trained to use the developments wisely and well. 

The Federal Interest in Research and Development 

One of the most vigorous and hopeful protagonists of educational re- 
search and development, in its connected denotation, is the federal gov- 
ernment. The growth of its interest represents a crucial factor in any cur- 
rent examination of the relationship between the production and utiliza- 
tion of new knowledge in education and in the administration of 
education. 

The birth of the new interest occurred in the mid-1950’s. Signal events 
included the National Science Foundation investments in building new 
curriculums in mathematics and science and the National Defense Educa- 
tion Act provisions to support programs in guidance and foreign lan- 
guages. The bulk of the federal investment went to the support of educa- 
tion as an instrument of national policy in international affairs. The 
public rationale behind the new programs rested heavily on the import- 
ance of our educational system in the maintenance and enhancement of 
our international posture. However, the soil was turned and the seeds 
were sown for expansion of domestic investments when the climate turned 
favorable. This turn of climate came with the convergence of the dreams 
of the New Frontier and Great Society and the demands of the Civil 
Rights Revolution. Both of these influences focused attention on the 
domestic scene; both called for the use of education as an instrument 
to pursue a wide array of national goals. 

The Cooperative Research Act also appeared in the mid 1950’s. It 
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provided an unparalleled impetus to the support of research in education 
in universities, and especially in schools of education, across the land. 
In addition, private corporations invested heavily in education in the 
decade from 1956 through 1965, with more emphasis on encouraging 
educational inventiveness and educational innovation than research per 
se. These investments in inventiveness and innovation, coupled with the 
work sponsored by the National Science Foundation and NDEA, con- 
tributed to and fed on an acceptance of change in education. Innovation 

99 

was in. 

Innovation in education was not, however, a hallmark or outcome of 
research projects sponsored by the Cooperative Research Act. It is not 
surprising, therefore, that someone should ask, after some ten years, 
“What has the $100,000,000 Cooperative Research Act ‘library’ contrib- 
uted to change in and improvement of educational practice?” 

This question helps to explain the current posture of the federal gov- 
ernment with respect to educational research and development, in the 
connected sense. Without raising publicly any serious questions about 
the quantity and quality of work supported by the Cooperative Research 
Act, federal policy makers and program managers turned to the question 
of the relevance and applicability of the results of the investigations to 
educational practice. Once this question assumes priority, quality takes 
second place to relevance. Contribution to knowledge, per se, is less im- 
portant than the contribution to improving educational practice and 
solving educational problems of national significance. 

R & D centers 

The establishment of the research and development center program in 
1964 marked a major leap by the federal government in support of 
problem-oriented educational research and development, deliberately con- 
nected. The decision to start this program clearly signalled intention to 
seek another alternative in addition to project research conducted by 
individual investigators and small teams, for systematic attack on and 
resolution of educational problems of national significance. It was a 
matter of some import to support development as a critical element in 
devising and applying solutions, with “research” funds. The program also 
took a calculated risk in placing heavy responsibility for development in 
university settings, where the reward system has traditionally placed 
highest value on the production of knowledge without reference to its 
applicability. 

Establishment of the research and development centers in a limited 
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number of universities prompted expressions of concern among some 
members of the research fraternity who viewed the center program m a 
competitor for scarce resources. Still, the program went forward on the 
grounds that it was necessary to stimulate systematically the pursuit of 
research and the development of new alternatives, based on research, that 
would contribute to the solution of critical educational problems and the 
improvement of educational practice. 

ESEA of 1965 

Hard on the heels of the establishment of research and development 
centers came the passage of the Elementary and Secondary Education 
Act of 1965. The ESEA of 1965 contained a vast range of aspirations and 
intentions. Its several titles were categorical, but as a total bill, it con- 
tained provision for strengthening education at many levels, in many in- 
stitutional settings, and along many routes, including the training of 
personnel. 

Titles I, III, IV particularly bear on the problem of how to improve 
the relationship between the production and utilization of knowledge in 
education. Title I and Title III claim the lion s share of ESEA funds. To- 
gether they present a heavy demand on the capital of research and educa- 
tional inventiveness. The demand appears to have exceeded the supply 
and to have revealed that existing capital needs much additional process- 
ing before it can be used. 

Title I addresses itself primarily to the alleviation of educational depri- 
vation. It assumes that increasing and improving educational and related 
services to children who live in pockets of poverty will make a difference 
in their educational progress. It assumes, also, that sufficient knowledge 
had been produced and that sufficient developmental effort had been ex- 
pended to permit the immediate installation of educational services that 
would make a difference. Time will tell whether Title I will achieve the 
results that its architects intended. Even now, however, there is reason to 
believe that provision for significant and time-consuming development 
efforts might have generated more powerful educational inventions. The 
expectation of immediate results made it difficult to undertake needed 
developmental work, rigorous field testing, and appropriate and specific 
training of educational personnel to use new materials and new proce- 
dures in major programs of compensatory education. 

Title III presents a somewhat similar picture. Originally, Title III envi- 
sioned a vast array of supplementary education centers and exemplary 
educational programs, to serve as the cutting edge for improving educa- 
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tion at the local level. It assumed that the supplementary components and 
exemplars were sufficiently well known and identified to allow immediate 
incorporation into school systems and to permit immediate display for 
others to emulate. 

Experience suggests that the storehouje of immediately exportable and 
utilizable supplements and exemplars was not as rich as originally be- 
lieved. Thus, a number of Title III projects were forced toward the boun- 
daries of educational development. The need to turn in this direction 
rather than to draw from a rich treasure of demonstrated educational 
developments speaks eloquently of the state of educational research and 
development. 

Title IV amended and extended the Cooperative Research Act. It au- 
thorizes educational research and related activities, including develop- 
ment, demonstration, dissemination, and training. It is in Title IV, partic- 
ularly, that one meets head-on the policy and managerial considerations 
that affect the production of new knowledge, the utilization of new knowl- 
edge, and their relationship. 

Title IV itself does not specify the proportion of funds to go to the 
various purposes for which the Title exists. As an extension of the Co- 
operative Research Act, it provides for continuation of support for proj- 
ect research by individual investigators. On the other hand, as the um- 
brella for research and development centers, it also provides support for 
programmatic research and development in education. In addition, its 
legislative history reveals that Title IV also provides the conceptual and 
fiscal foundations for a new institution, the regional educational labora- 
tory. 

Together, the research and development centers and the regional educa- 
tional laboratories represent deliberate creation of instrumentalities to 
pursue educational research and development aimed at problem solving 
and improvement of practice. They constitute a new apparatus for pro- 
ducing and utilizing new knowledge in education. As new instrumentali- 
ties, the centers and laboratories also represent alternatives to the project 
research route. They do not, however, exhaust all possible routes for the 
production and utilization of new knowledge, considered separately or 
collectively. The breadth of the Title IV’s authorization permits policy 
makers and program managers to keep open the range of alternatives 
which are or may become available. Still, the centers and the laboratories 
do comprise a large existing network addressed specifically to the rela* 
tionship between the production and utilization of new knowledge in 
education. And, integral to both sets of institutions is the centrality of 
educational development as a major activity. 
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Inquiry and development 

As to the inquiry phase of research and development, there is general 
agreement that both quantity and quality should be increased. There is 
no real issue here, except to find ways and means to accelerate the pace of 
improvement. The problem is how to do so. 

Who really supported research in and on education before the period 
of enlarged federal investment is not well documented. In any case, since 
the passage of the Cooperative Research Act, the fate and destiny of the 
production of new knowledge in education have become inextricably 
wedded to the policies and actions of the federal government with respect 
to the support of rigorous inquiry and sophisticated scholarship. It is not 
surprising, therefore, that the issue, as ceen by the educational research 
fraternity, is that the federal government should support research in edu- 
cation more strongly and more abundantly. The more successfully the 
fraternity pursues the issue, the more dependent will be the inquirers on 
federal policy and its execution ; and the more interested they will become 
in continuing their efforts to influence federal policy. The problem is how 
to create an argument that appeals to policy makers and program man- 
agers who participate in allocating public funds. How powerful a case can 
be made for inquiry for its own sake? What priority should exist for 
supporting inquiry qua inquiry as compared to programs which aspire 
to or promise direct application or utilization of knowledge? 

It is instructive to note, on this score, that the standards of productivity 
applied by institutions which house the inquirers, and by their peer 
groups, do not square with the standards of productivity applied by policy 
makers and program managers. In the former instance, the relevant ques- 
tion tends to be, “How good is the research?” In the latter instance, the 
relevant question tends to be, “What difference does (or can) it make?” 

The scholarly inquirer may show great impatience, even disdain, in the 
face of the latter question. He may consider it irrelevant. And, indeed, it 
may be irrelevant to the institution which employs him and to the com- 
pany of equals which constitutes his reference group. However, the ques- 
tion is not irrelevant to the fraternity of inquirers as a total fraternity. 
The more evidence of difference that some (not all) inquiry makes, the 
more likely that there will be enthusiasm for support of inquiry for its 
own sake. Few policy makers and executives really expect all inquiry u 
pay off in difference in practice. But they do expect that some inquiry 
will pay off. As they see evidence of benefit, they tend to become more en- 
thusiastic in their support. 

Given the benefits orientation of public policy makers and program 
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managers, it appears essential to demonstrate that some (not all) inquiry 
can and does contribute to the improvement of practice, that inquiry does 
make a difference. It appears essential to turn the attention of some in- 
quirers (not all) to inquiry that is oriented to problem solving, that is 
designed specifically to contribute to improvement ip practice. Some in- 
quirers are already so oriented ; some are not. Some are some of the time, 
but not all the time. And some apparently can be attracted to problem- 
solving, at least some of the time. 

Here, again, development as an activity promises to contribute signifi- 
cantly. Development is an openly benefits-oriented activity. But, develop- 
ment also creates a voracious demand for research output, as well as edu- 
cational inventiveness. Heavy investment in educational development, 
then, augurs well not only for improving the relationship between the 
production and the utilization of knowledge, but also for increasing the 
base of demand on and for inquiry qua inquiry. 

The interest and support of the educational research fraternity in 
development as a valued activity should be clear. Its benefits orientation, 
its dependence on and consuming appetite for the fruits of inquiry qua 
inquiry, and its critical connection to the domain of utilization all combine 
to make development an extremely important enterprise for the educa- 
tional researcher. The stronger the conjunction in research and develop- 
ment, the more powerful will become the combined concept, and the more 
probability of enthusiasm on the part of public policy makers for each 
part of the concept as well a3 the combination. 

Inquiry In Educational Administration 

Research in educational administration received strong stimulation 
from the Cooperative Program in Educational Administration, supported 
by the Kellogg Foundation. The Cooperative Research Program of the 
U.S. Office of Education, other public resources especially in major state 
universities, and private foundations have continued the initial stimula- 
tion. 

These stimuli prompted an accelerating shift from the normative to 
the theoretical and empirical analysis of administrator, and more recently 
of organizational behavior in education. Also, students of the economics 
and politics of education turned with vigor to the conceptual and meth- 
odological tools of relevant social sciences. 

In spite of the growth of much interest, and some competence, in re- 
search in educational administration over the last 15 years, it seems that 
educational administration remains more a site for inqiaSry than a well- 
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developed field of inquiry. If continuing observations confirm this view, 
a question of the first order is whether additional alternatives for im- 
proving inquiry in and on educational administration deserve further 
exploration. 

Current alternatives for improving research in the field include: first, 
attempts to raise the level of preparation for inquiry of students enrolled 
in educational administration programs; second, attempts to secure and 
maintain the active participation of investigators trained as behavioral or 
social scientists; third, attempts to combine the first and second alterna- 
tives. A decade or so of efforts devoted tc the first alternative has pro- 
duced little increment in the research capital in educational administra- 
tion beyond a low hill of doctoral dissertations and an even smaller 
mound of publications based on these dissertations. Available evidence 
suggests that a severe discontinuity enters into the career history of the 
majority of students of educational administration between completion 
of their dissertations and their ascendancy in the academic ladder to the 
professorship. This observation does not hold for all professors of edu- 
cational administration, but even at the most prestigeful institutions, it 
characterizes the mode of behavior. In sum, remarkably few professors 
of educational administration, whatever their preparation, conduct and 
publish their own research. 

The record of investigations by researchers trained as behavioral and 
social scientists is better. Most of the major contributions have come 
from them, except perhaps in the special field of educational finance. 
Compared to the output of scientists trained in relevant disciplines, at- 
tempts to increase the production of new knowledge in educational admin- 
istration by way of improving the competence for inquiry of students in 
educational administration programs look puny. 

Perhaps not enough time has elapsed to make firm judgments about 
the long-range power of new preparation programs that stress inquiry 
training and scholarly productivity. It may be that another generation of 
student output will demonstrate completion of the transfer from the 
normative to the scientific orientation of educational administration. It 
may also be that more rigorous application of university reward and 
value systems to professors of educational administration will accelerate 
the pace of the transition. 

Existing data do, however, prompt the question of whether a depart- 
ment of educational administration (or its equivalent), conventionally 
located in a university school of education, constitutes the most promis- 
ing base for encouraging inquiry in educational administration or for 
preparing researchers in the field. To date, the conventional structure has 
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not produced sufficiently to warrant great confidence in its ability to meet 
these tasks. 

The experience of the Kellogg years led to several noteworthy efforts 
to depart from the conventional structure, including the School Executive 
Studies program at Harvard, the Midwest Administration Center at Chi- 
cago, and most recently, the Center for the Advanced Study of Educa- 
tional Administration at Oregon. The University Council for Educational 
Administration also grew out of the Kellogg stimulation to educational 
administration, but more on this score later. The Institute for Adminis- 
trative Research at Teachers College represents another structural varia- 
tion, but one that sprang from a base separate from the Kellogg invest- 
ment. Collectively, the record of these institutions offers evidence that a 
new structural design may contribute powerfully to improving the pro- 
duction of new knowledge in educational administration. 

Suppose one were interested in creating a new institution whose pri- 
mary goal would be to increase the quality and quantity of new knowl- 
edge in educational administration. Where should it be located? How 
should it be staffed? 

Given the goal, a major university would provide the most compatible 
setting. Given the major domains of inquiry — the politics and economics 
of education and relevant extra-organizational and intra-organizational 
variables — the core of investigators would come from a background of 
training in relevant disciplines rather than from a background of training 
in educational administration. To provide continuous contact with and 
entry to the field, however, it would be desirable to include a cadre of 
investigators who came out of preparation programs in educational ad- 
ministration, but programs laced with substantial study and use of the 
concepts and tools of the behavioral and social sciences. 

A mix of these types of investigators would probably prefer to work 
in an organization set up separately from a school Ci department of edu- 
cation. And they probably would prefer to think in terms of long-term 
rather than permanent association. The organization would then provide 
permanent posts, but not permanent incumbents. The principle of selec- 
tively structured turn-over would prevail. 

There is probably need for no more than five to ten such centers or 
institutes across the nation. Partly this is so because of the realities of 
optimal staffing. Partly it is so because educational administration, as a 
site of inquiry at this point in time, needs no more than five to ten major 
centers addressing themselves to the territory on a continuing basis of 
tile highest quality. 

This suggestion for a new design smacks of a return to the CPE A model 
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of a few, major regional centers spread across the nation. To say so 
openly is not to apologize. It is to advocate the position that the CPEA 
pattern provided a thrust for inquiry in educational administration which 
was unparalleled prior to its creation and which has not really been 
matched since. This is not to say that the CPEA structure was perfect 
and that it could not be improved or strengthened. Associated with the 
proposed centers of inquiry should be a network of units or arms that 
would concentrate specifically on developmental work in educational 
administration. Movement of personnel from the centers of inquiry to 
the units of development should be open and easy. Each developmental 
unit should be closely connected to all of the inquiry centers rather than 
to just one center. The development units would be avowedly problem- 
and benefits-oriented. They would create insistent and consistent demand 
for problem-oriented inquiry, which would command the attention of 
some of the investigators at the research centers on the basis of interest 
and competence. Their mission orientation, rather than their research 
orientation, would cast the development units more in the mold of the 
new regional educational laboratories than in the mold of traditional uni- 
versity patterns. Some of the development units might be organizationally 
united with some of the research centers, but there would be no need for 
all of them to be so organized, nor for all of the research centers to create 
their own developmental arms. 

Administrator preparation 

Perhaps the most controversial feature of the proposed design, how- 
ever, is advocacy for reducing to 20 or 25 the number of institutions in 
the nation that prepare educational administrators and for urging them 
to concentrate unabashedly on preparation for practice rather than mix- 
ing preparation for practice with preparation for inquiry. If for no other 
reason, this suggestion deserves consideration because it would permit 
experiments in training with larger classes of full-time students that might 
generate conclusions on what makes a difference in training. 

The way things stand now, with programs scattered over hundreds of 
institutions, with students coming and going at all hours and at all times, 
no one will ever really be able to say very much about what makes a 
difference in training or why. 

From these fewer, larger, and more adequately staffed centers of prep- 
aration, appropriately endowed and interested graduates could go on to 
the research centers or development units for additional preparation for 
specialized roles in the field of educational administration. 

The time is ripe to join again the issue of whether there are too many 
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marginally equipped institutions involved in administrator preparation. 
The new Educational Professions Development Act may provide an appro- 
priate opportunity to do so. In any case, the current status of inquiry in 
educational administration, as well as the current status of preparation 
programs for researchers and practitioners, demand examination and 
creation of new alternatives beyond more of the same to move the field 
forward. In addition to the pieces of structural apparatus proposed above, 
two others appear desirable. The first is creation, first advanced by Al- 
bright (1962), of three or four equivalents to the staff and command 
schools maintained by the military. This type of institution promises to 
be uniquely suited to the needs of educational administrators in mid- 
career, who have used up the intellectual capital of their original prepar- 
ation and who are moving into positions of increased responsibility and 
scope. The second is creation of one or two extension-type centers in each 
state, or in regions if population is sparse, to serve as outlets for bringing 
new ideas on a continuing basis to practicing administrators in the field. 
The staff and command school equivalent might well be associated with 
a research center piece of the total apparatus. The extension center 
equivalent might be sponsored by administrator’s associations or one of 
the teaching institutions. 

If these pieces of apparatus remain scattered and structurally discon- 
nected, there is probably no more hope in the proposal than there exists 
in current arrangements. Consequently, a great effort needs to be ad- 
dressed to establishing a real network in which and to which all of the 
separate pieces contribute in a specialized yet highly cumulative fashion. 
The one previous effort to achieve a goal of this consequence proved to 
be abortive; yet, it carried the field forward. The old issues need to be 
reopened, and the new issues faced, to permit the next step to be taken. 

The Developmental Component in 
Educational Administration 

Reliance on conventional and traditional approaches characterize the 
majority of efforts to connect the production and utilization of knowledge 
in educational administration. Classroom instruction by professors dom- 
inates the scene, supplemented by workshops, consultation, surveys, text 
writing, and journal publication. Serious and continuous developmental 
efforts of consequence are virtually nonexistent, except perhaps in the 
specialized field of educational finance. As in education generally, so in 
educational administration it is not enough to explore ways and means 
to improve the quality and quantity of inquiry. There is need also to 
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.oover how to strengthen the totality of research and development, in 
both their separate and connected senses. 

Earlier reference to the desirability of creating specialized develop- 
ment units for educational administration reflected this central thesis. 
There are several major spheres of developmental work that come to mind 
as immediately feasible. The first is the development of curriculums for 
the preparation of administrators; the second is the development of or- 
ganizational forms or structures for educational systems that are likely 
to make a difference in the way the systems carry out their tasks; the third 
is the development of administrative processes and procedures. 

UCEA has represented a major force in curriculum development for 
preparation programs for educational administrators, in its own head- 
quarters and in its member universities. Still, curriculum development 
in educational administration today looks very much like the conven- 
tional local school system approach. It is disparate, fragmented, uneven, 
scattered, and mainly non-cumulative. Nor can anyone really say much 
about what difference it has made. Certainly there is evidence of more 
use of behavioral and social science concepts and research findings in 
educational administration courses and workshops. However, there is 
preciously little evidence available about the impact on practice of the 
increased turn of educational administration to the social and behavioral 
sciences over the last 15 years. 

, A singular exception to the prevailing pattern shows itself in the UCEA 
sponsored work on the Jefferson School District simulation and associated 
in-basket materials and, more recently, on computer-aided instruction. 
The contributions to date of the UCEA sponsored efforts prompt consid- 
eration of expanding this typ3 of work on a massive co-ordinated scale 
of the order undertaken by PSSC, SMSG, and BSCS. One way to mount 
such a development program in curriculum would be to assemble in one 
place for as long as a year just one professor on leave from each UCEA 
institution for the sole purpose of building at least two or three alternative 
curriculums for the preparation of educational administrators. Clearly, 
it would be desirable to mix into the team a substantial core of specialists 
from relevant behavioral and social sciences and another core of practi- 
tioners who are intimately familiar with the field. And it would be desir- 
able to provide continuity in the developmental work through assignment 
of some staff on a long-term basis and opportunity for others to return 
regularly for summer sessions or equivalent blocks of time. 

The goal of an effort of this magnitude would be to prepare complete 
instructional systems, including specifications for entire programs, con- 
tent and materials, teaching procedures, and provision for training in- 
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structors specifically to use the new materials and procedures. The build* 
ing blocks for a sizable chunk of this effort already exist, but they are 
scattered in bits and pieces over a wide landscape. Their assembly, and 
cogent additions to them, into several alternative instructional systems 
constitute a next order of business. It would be especially valuable if 
these instructional systems were truly field tested before advocacy of 
adoption in raw form. It would be all the more powerful if there were 
only a relatively few preparation institutions into which the instructional 
systems required installation so that something definitively useful could 
be said about the effects of administrator education and training. 

With respect to new structural and organizational forms, it would be 
equally desirable to move from the posture of advocacy to the posture of 
creating, testing, and installing them in ways that are likely to demon- 
strate credible differences. The primitive stage of this type of activity 
already exists in the survey movement. Hardly a survey has ever been 
made that did not recommend one form or other of school or school sys- 
tem reorganization. The assumptions, convictions and beliefs on which 
these recommendations rest fall under the heading of conventional wis- 
dom. Carefully designed and executed field testing in pilot situations is 
not a hallmark of the recommendations of survey teams. Even more to 
the point, seldom have the survey recommendations themselves been 
treated as hypotheses, followed by careful data collection and observation 
to ascertain whether or not the intended outcomes were achieved. 

Schools and school systems are complex formal organizations living in 
complex social, political, and economic environments. As total systems, 
or as sub-systems of larger systems, they represent extremely difficult 
places in which to introduce elements of new form or structure to field 
test as part of an iterative and long-term developmental effort. For this 
reason, if for no other, provision for pilot and demonstration schools and 
school systems, of representative types, would need to be closely associ- 
ated with the developmental units recommended earlier. The ability of 
the Flexible Scheduling Project at Stanford and the IDEA network out 
of UCLA to create such arrangements reveals that schools can be re- 
cruited for long-range developmental involvement. The various school 
study councils spread across the nation may also constitute fertile soil 
for similar involvement. 

In addition, given the general difficulty of securing access to school 
systems for development work of a structural character, continued effort 
should be addressed to constructing simulated models which will permit 
approximate testing of the effects of structural changes. These models 
will probably always fall short of the real thing, but they do offer great 
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utility for “de-bugging” the crucial fine points that can make or break 
a serious development effort. 

The domain of administrative processes and procedures also stands 
ready for major developmental attack. Decision-making, for example, 
has commanded attention for years as a crucial slice of administrator 
behavior. Several significant projects in computer-assisted simulation 
models have already appeared in prototypic form in other fields. These 
models may not fit educational administration, but they deserve careful 
examination as a potential base on which to build. 

Beyond the simulation stage lies the opportunity to develop specific 
programs which provide both for training school executives in various 
styles of decision-making deemed appropriate to varying sets: of condi- 
tions and structural form and also for testing these styles in action. As 
things stand now, training for improved decision-making consists pri- 
marily of didactic encounters, sometimes supplemented by participation 
in in-basket exercises. Computer-assisted simulation may move training 
one notch higher in the scale of reality. Properly constructed and super- 
vised internship, encompassing reality and authenticity (themselves un- 
common), may raise the level even higher. However, to further advance 
decision-making as an administrative skill, appropriately constructed 
and executed field testing of several models of decision-making in the 
real world of educational administration appears essential. 

Conclusion 

Emphasis on the importance of development as an activity of great 
consequence in no way deprecates the importance of other building 
blocks in the lJttionship between the production and utilization of 
knowledge. These other blocks, such as credible demonstration and 
sophisticated dissemination, constitute critical elements in the total set 
that makes for sufficiency in promoting and improving the relationship. 
The burden of the argument here is that development is the keystone. 
When it achieves a higher status as a rewarded and valued activity, the 
central issue will be joined squarely and the central problem will be 
moved closer to solution. 
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More than a decade ago I was a self-styled “expert” in the area of ad- 
ministrative staff relationships. My colleague at the University of Chicago, 
Jack Getzels, and I strove mightily to put the terms “nomothetic” and 
“idiographic” into the vocabulary of every practicing administrator in 
the country. I recall that we made a lot of speeches on the subject, Jack 
and I, and usually there was a question or discussion period following. 
Almost inevitably this comment would come from someone in the audi- 
ence, “What you say seems to make some sense, although I’m not sure I 
really know what you’re talking ahout. Why don’t you fellows come down 
out of your ivory tower and tell us about your ideas in language that we 
can understand? How about showing us how to apply those ideas ‘on the 
firing line’?” 

“Well,” we would say, “practice is hardly our concern. We don’t know 
what the practical problems are. It’s up to you administrators who have 
to deal with these problems every day to make the application. And as for 
not understanding our language, well, you can hardly fault us for that. If 
we are in the ivory tower, then you are surely in the basement. If we 
should descend so as to speak your language, why don’t you ascend and 
meet us at least halfway up?” 

Thereupon the discussion would end in an impasse. The listeners would 
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go away feeling that they had been led to the trough but kept from drink* 
ing, because the theoreticians had failed to say anything that made oper- 
ational sense to them. “If applications are to be made,” they would ask, 
“who is better able to make them than the minds that developed those 
ideas in the first place? It is only because they are uncooperative that we 
can’t use what they have discovered.” 

We, the speakers, would go away equally disillusioned, feeling that we 
had been pouring the water into their open mouths hut that they had 
refused to drink. “For who,” we would ask, “should be better able to 
appreciate and apply what we have to say than the men who are daily in- 
volved with the very problems we have been analyzing? It is only because 
they are lazy and ignorant that they won’t use what we have discovered.” 

And so, to point the moral, the uncooperative researcher-theoreticians 
and the lazy, ignorant practitioners would go their own self-satisfied ways, 
each convinced that the fault for any lack of communication lay with 
the other. 

Now I recall also that when I made these speeches on the ^omothetic- 
idiographic theme, I would usually start my remarks with the observation 
that I had never been an administrator myself an<ui never hoped to be one. 
But about a half-decade after this time, I suddenly did find myself an 
administrator, not of a school system to be sure, but of a bureau of educa- 
tional research and service, with a staff about the same size as might he 
found in a middle-sized school. I had the usual “honeymoon” and then 
my problems began. One day, perhaps six months after I had taken office, 
I suddenly sat up in my overstuffed administrator’s chair and said, “Why 
most of my problems are being generated by people. People are no damn 
good!” 

It was just at that point that the full significance of a farewell card 
that had been given to me by the staff associates in the Midwest Admin- 
istration Center when I left Chicago hit me. “If you’re so smart,” it read, 
“why aren’t you rich?” Or to quote from another idiom, the phrase 
“Physician, Heal Thyself’ came home to me with a new forcefulness. How 
was it that a man of such great theoretical expertise in the staff relations 
area should suddenly conclude that people are no damn good? No use to 
claim that I couldn’t understand the theoretical language — I had helped 
to invent it ! 1 No use to claim that practice was hardly my concern — I was 
up to my neck in it! What then was my problem? Why was I having so 

1 The terms “idiographic” and “nomothetic” were picked from Roget’s Thesaurus 
by me one wintry afternoon when I had nothing better to do than to try to find some 
new and interesting terms to use in our theory. We justified this at the time by claim- 
ing that we had to find terms “untainted” by value connotations. 
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much trouble applying the ideas that I had myself helped to formulate? 

The answer to the latter question was some years coming, and has two 
parts, I now believe: 

1. There is a tremendous gap between knowledge production and 
knowledge utilization that cannot be spanned either by the producer 
or by the utilizer himself, or even by these two acting in concert, at 
least in the typical situation. New mechanisms and agencies using 
special techniques are required to perform this bridging or linking 
function. 

2. Knowledge is at best only one of a number of input factors in any 
practical situation. No practical problem can be solved using knowl- 
edge alone — a whole host of economic, social, political, motivational, 
cultural, and other factors must be considered. 

Let me illustrate these two points with some examples. First, in relation 
to the gap between knowledge production and knowledge utilization, edu- 
cation seems to be literally centuries behind other areas of endeavor in 
recognizing the gap and in making provisions for its reduction. In the 
physical sciences, for instance, engineering activities were instituted for 
precisely this purpose. Consider the Bell Telephone Laboratories as an 
agency for knowledge production and the Bell Telephone system as an 
agency for knowledge consumption and application. Now a great deal of 
knowledge production, commonly called basic research, goes on in the 
Bell Laboratories; to cite one instance, much of the research in solid state 
physics leading to the discovery and development of transistors was con- 
ducted there. But it is a long step from developing transistors as a labora- 
tory curiosity, however exciting their potential might be, to utilizing the 
transistor principle in building better dialing and switching equipment. 
No one expects the scientists in the Bell Laboratories to make such applica- 
tions; indeed, if anyone were to suggest it, the idea would be thrown out 
on the grounds that scientists would be diverted from what they do best 
and turned to a task that they could do but poorly. 

Instead, AT&T in its wisdom has interposed a vast organization be- 
tween the knowledge producers and the ultimate consumers. This system, 
known as Western Electric, has the unique mission of making the applica- 
tions and producing the ultimate devices which the various Bell systems 
will install and use. Western Electric has its own coterie of engineers, 
who are themselves divided into specialties. Some of their personnel are 
concerned with developing prototype applications; others with testing 
these out and debugging them. Still others are concerned with designing 
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these applicators in ways that will make their production feasible and 
economical. And finally, of course, there are production specialists who 
actually turn out the devices that will be installed and used by the Bell 
Telephone companies. 

This whole system seems to us only right and natural when we think 
of the physical sciences. But in education, even if there were good and 
plentiful basic re ;h findings, there is no mechanism similar to the 
Western Electric v .npany, unless the R&D Centers and/ or the Regional 
Educational Laboratories eventually assume this function, to carry on the 
intermediate functions of development, testing, and production. And as 
my original example indicates, as recently as a decade ago this lack had 
never even crossed our minds; instead, we were content to write off the 
research-practice gap as stemming from the uncooperativeness of the re- 
searchers or the laziness and ignorance of the practitioners, or both. 

Let me dwell now for a moment on the second part of my answer to 
the question of why there is so much difficulty in applying new knowledge, 
viz., that knowledge is, at best, one of a number of input factors in any 
practical problem situation. Let me use a real even if somewhat absurd 
example. In one school district I know about in the hills of Appalachia 
all of the power is held by the president of the Board who happens also 
to be the town physician. He has always controlled enough Board votes 
to hire and fire superintendents as he pleases. But this physician has one 
great vice: he is a morphine user. Now as a physician he had easy access 
to morphine and was able to provide himself with all that he needed to 
support his habit. But recently the state drug authority discovered his vice 
and relieved him of his license to prescribe narcotics. Hence he has had 
to turn to other sources for his supply, in this case, the local county health 
officer who is also his close personal friend. 

Now it happens tha£ the incumbent superintendent has somehow dis- 
pleased the Board president, a failing that has cost the jobs of all of his 
predecessors. But the incumbent has one trump card: he happens to be 
the nephew of the county health officer. Hence the physician is faced with 
the difficult choice of firing the superintendent and losing his supply of 
narcotics or retaining the superintendent and having to put up with his 
nonconformist tendencies. A Hobson’s choice indeed! 

If we could find a candidate for the superintendent’s job in this district 
who had ready access to a supply of drugs, great things might be accom- 
plished. The incumbent is not in this happy situation, and every action he 
takes will have to be examined in terms of its potential for upsetting the 
delicate balance of power that presently exists. Get the physician too 
angry and he may decide that he can find some other source of drugs after 
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all. If new knowledge is to be inserted into this school system’s workings, 
it will have to be able to survive this scrutiny. 

My colleague, Henry M. Brickell, has put the case mors eloquently than 
this homely example illustrates. He says: 

When research-based information does exist, it must take its place be- 
side all the other information available. The research finding may coincide 
with and confirm the other information. In such a case, the chances of its 
being used are good. Or it may be the only source of information on a 
specific topic, in which case its chances of use are possibly only fair be- 
cause it is not substantiated by experience. Or it may conflict with other 
information, in which case the situation is one of competition. 

In the United States even today, research findings do not compete well 
against such established, persuasive information sources as one’s personal 
experience or knowledge of what other schools are doing. For example, 
when a local school asks, “What might we adopt to solve our particular 
problem?” a very limited number of solutions (at best) generated through 
a research and development process compete for its approval with a 
larger number of solutions which have been generated without benefit of 
research. The prospective adopter is not likely to select the research- 
based solution solely because it stands on a base of scientific knowledge, 
especially if something else is less expensive , easier to install , preferred 
by the faculty, or otherwise attractive. (Italics added.) (Brickell, 1967, 
p. 235.) 

Let me call your special attention to the very last part of that quotation, 
which asserts that research-based solutions to educational problems are 
not likely to be selected if they are in competition with other solutions 
that are less expensive, easier to install, preferred by the faculty, or other- 
wise attractive. Mere knowledge, Brickell seems to be saying, is not 
enough; there are other economic, feasibility, and motivational factors 
that must be taken into account. And he might well have added social, 
political, cultural, and psychological factors as well. Whoever and what- 
ever it is that will bridge the gap between knowledge production and 
knowledge utilization will have to be sophisticated enough and shrewd 
enough to assess these factors and be able to cope with them. In general 
I would assert that the typical researcher surely, and probably the typical 
administrator, do not have the special training and equipment for this 
purpose. 



The Theory-Practice Continuum 

If my analysis is correct, so that special mechanisms and agencies will 
be needed to fill the enormous gap between knowledge production and 
knowledge utilization, where are these to come from and what will their 
nature be? To deal with these questions I will need to digress for a 
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moment to describe to you the categories of a theory-practice continuum 
which my colleague, David L. Clark and I have developed and published 
in other contexts . 2 I would like to begin by defining the various phases of 
this continuum and then proceed by discussing certain of their relation- 
ships. 

Clark and I have talked about four phases or stages in this continuum, 
viz., research , development, diffusion, and adoption. Our concern today 
is with the middle two of these four, but I believe it is important to distin- 
guish them from the other two, with which they are sometimes confused. 

Research has as its basic objective the advancement of knowledge. The 
researcher is not concerned, nor should he be, with whether or not his 
research has an evident practical application. He needs freedom to pursue 
his ideas wherever they lead; he needs to be free to fail on occasion; he 
needs to be free from pressures for an immediate payoff. Research pro- 
vides one input for the next phase, development. 

Development has as its basic objective the identification of operating 
problems and the formulation of solutions to those problems. The devel- 
oper, unlike the researcher, is most acutely concerned with practice. It 
is his job to make practice conform to the highest ideals that can be set 
for it, to be constantly probing the system to determine what, if anything, 
is keeping it from functioning at its best, and then to devise new ap- 
proaches and techniques to ameliorate or eliminate whatever problems, 
he may identify. In devising such problem solutions the developer bor- 
rows heavily wherever he can — from research, from experts, from his 
own experience. 

Rut development implies more than just coming up with an answer. 
The answer must be one that will work in the real world. It must be one 
that can be adapted into the system. It must be one that is usable by the 
personnel available. It must get results. Thus development involves pro- 
duction, engineering, packaging, and testing a proposed problem solution 
or invention. 

Diffusion has as its basic objective the creation of awareness about new 
developments and the provision of opportunities for their assessment 
along whatever dimensions practitioners may deem necessary. The most 
potent solutions that men can devise to overcome their problems have 
little utility if practitioners are not informed about them, or if they have 

2 See, for example, our papers, “An Examination of Potential Change Roles in 
Education,” NEA-CSI Seminar on Innovation in Planning School Curricula, Aerlie 
House, Virginia, October, 1965; and “Effecting Change in Institutions of Higher 
Education,” UCEA International Inter-Visitation Program, Ann Arbor, Michigan, 
October, 1966. 
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little opportunity to discover how the solutions work. Diffusion, in short, 
makes the solution available and understandable to the practitioner. 

Adoption, has as its basic objective the adaptation of a development to 
the local situation and its installation therein. This is by no means an 
easy task. Every situation has its own peculiarities, so that it is unlikely 
that a newly developed problem solution, an invention, as it were, can 
simply be slipped into place without considerable modification to itself, 
to the system, or to both. Further, no prudent local administrator would 
agree to such an installation without some kind of previous trial. When 
the development passes this test there is still the matter of assimilating the 
invention as a component part of the system. This assimilation may in- 
volve the training of local personnel, modifying available space, arrang- 
mg appropriate scheduling, and the like. 

I have found it instructive, in thinking about these four stages, to de- 
velop a taxonomy of activities at each step that indicates what the re- 
searcher, the developer, etc., actually do. Again, we may consider each 
of the four phases in turn. 

Research 

It wifi be sufficient for present purposes to classify all possible research 
activities into four categories which I shall term depicting , relating , con - 
ceptualizing, and testing. This taxonomy, (Figure I) is not generated in 
any systematic way but emerges from the following chain of reasoning: 

Figure 1 



RESEARCH ACTIVIT Y 

DEPICT 

RELATE 

CONCEPTUALIZE 

TEST 



When a researcher approaches a new topical area about which little 
is known, there is little that he can do other than describe the phenomena 
of interest. This description may take either qualitative or quantitative 
form. So, for example, a researcher might describe a group as being com- 
posed of both boys and girls, or as consisting of 67 percent males. I shall 
use the term depict to refer to such a general description. 

After a sufficient amount of depiction takes place it becomes possible 
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for the researcher to relate depicted entities. So he may note that lipstick 
is worn exclusively by females, or that seven out of ten females wear lip- 
stick while zero out of ten males wear it. He may also note that cancer 
of the lung seems to be related to cigarette smoking or that the correlation 
of height and weight is 0.71. 

A sufficiently developed network of relationships makes it possible to 
suggest reasons for them. Why do certain phenomena tend to occur to- 
gether? Why is lightning always followed by thunder? These questions 
lead directly to conceptualization , which we may regard as attempts to 
account for the observed depictions and relations. 

These efforts at explanation may be tested to determine the valid- 
ity of the conceptualization. To the extent that hypotheses are borne 
out, the formulation may be regarded as valid. In this testing process 
many of the same techniques used in the depicting and relating stages 
may be used again; typically, however, experimental methodology is em- 
ployed which tests the hypothesis in a context-free (i.e., controlled) en- 
vironment while holding the possible effects of other factors in abeyance. 

The reconstructed logic of the research process is thus as follows: The 
aim of research is understanding. Understanding may be said to be 
achieved when a theory or taxonomy permits an explanation of the phe- 
nomena of interest, and of the relationships they bear to each other. 
Theories are built initially from systems of depictions and relations. The 
presence of the imperfect theory so devised makes possible more refined 
conceptualization. Further tests will confirm or deny the validity of the 
refinements. The four steps of depicting, relating, conceptualizing, and 
testing, successively repeated, will thus produce a very sophisticated sci- 
ence over time. 

Development 

Development activity may also be conveniently broken down into four 
categories which bear a curious similarity to the four categories of re- 
search. I shall term these development categories (Figure 2) depict , in- 
vent , fabricate, and test. They are derived by the same sort of intuitive 
logic as are the research categories. 

Development begins with the identification of problems. The developer 
is concerned with causing practice to conform to the highest ideals which 
he can imagine, but of course it never does. Certain desirable objectives 
are not reached, while other goals, perhaps even undesirable ones, are in 
fact attained. Those desirable goals which are attained may be achieved 
only imperfectly; there is always room for improvement. Whole new 
goals may become apparent for which the system makes no allowance, 
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Figure 2 
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or older goals once considered important become less so. All of these 
factors require some alteration in tLe system. The developer’s first job 
is thus to depict the state of affairs so that needs and problems can be 
identified. 

Problems call out for solutions, and the developer’s next task is to 
invent them. Now invention may take a variety of forms. First, it is con- 
ceivable that a solution already exists and simply needs to be applied. 
So, for example, a reading problem at the first grade level might be 
solvable through the adoption of the initial teaching alphabet (i/t/a). 
Perhaps a direct analog is known and simply needs to be adopted, e.g., 
teaching reading to blind children might be accomplished by adapting 
i/t/ a to braille. Possibly an indirect analog exists which can be converted 
into usable form, e.g., a reading program for teaching adult illiterates in 
the military might be transformable into a new introductory reading pro- 
gram for culturally disadvantaged youngsters. Or, the elements from 
which a solution may be devised may exist but may need to be appropri- 
ately combined to yield a solution ; thus, several extant reading approaches 
may be combined to yield a relatively new approach. Finally, it may be 
necessary to invent a solution de novo , as was apparently done in the case 
of the initial teaching alphabet in the first place. We may speak of trans- 
mitting , translating , transforming , synthesizing and creating to describe 
these five different possible ways of arriving at a proposed problem 
solution . 8 

The fact that a solution is identified by whatever means does not signify 
that it is ready for application. Merely hitting upon an idea like i/t/a 
does not make it possible to begin using it at once. Materials have to be 
developed. These materials must be combined into appropriate sequences. 

3 The three terms transmit, translate, and transform were used by the Committee 
on Research Utilization of the American Educational Research Association to describe 
three ways in which research findings can be moved into practice. The terms have a 
somewhat different connotation here. 



46 



Knowledge Production and Utilization 



The technique must fit into other ongoing school activities. I will call all 
of these operations taken as a whole fabrication ; the term is intended to 
cover the entire gamut of engineering and packaging phases that may be 
required to make the invention “market ready,” as it were. 

Finally, the proposed solution must be field tested. It was devised to 
overcome some problem; does it in fact succeed? Does it work according 
to specifications? Should some refinements be made? Questions of this 
kind can be answered only through a comprehensive trial. And this trial 
must take place in authentic school situations; otherwise the applicability 
of the findings to the real world of education is dubious indeed. 

The reconstructed logic of development is thus as follows: the devel- 
oper, through a continuous monitoring of operational data (akin to proc- 
ess control) , identifies particular operational problems which require solu- 
tion. He invents a solution by transmitting, translating, or transforming 
already existing solutions, by synthesizing solutions from known but pre- 
viously uncombined components, or by creating solutions de novo. In all 
of these processes he may look to research for guidance but research will 
be but one of several competing inputs. The invented solution is engi- 
neered into usable form, and finally is tested in a real school situation. 
Its use is then warranted in the schools. 

Let me digress here to make clear a fundamental distinction between 
research and development, two processes which are often confused. There 
are several reasons for this confusion. First we are often tempted to 
describe what I have here called “research” as “basic research,” and what 
I have called “development” as “applied research.” This formulation gives 
the impression that research and development are simply different ends 
of the same continuum; indeed, someone has suggested that basic re- 
search is simply applied research with a time lag. But to commit this 
error is to ignore the fact that research and development have entirely 
different objectives; they are complementary processes to be sure, but 
they serve different goals. 

A second reason for the confusion is that persons engaged in research 
and development often are seen to be using similar techniques. Thus sim- 
ilar instruments, design, field procedures, and data processing methods 
may be observed. But surely we will not fall into this trap; to do so would 
be akin to saying that because plumbers, carpenters, and masons all use 
hammers they are all doing the same thing. 

A more pervasive and compelling reason for confusing research and 
development stems, I believe, from our intuitive understanding that the 
gamut of activities embraced by each tends to begin and end in analogous 
operational modes, just as our taxonomies of research and development 
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both begin and end with the same terms: depict and test. I have juxta- 
posed the two taxonomies in FIGURE 3 to make this clear. 



Figure 3 
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The crucial differences between these two phases may be delineated by 
going back to the basic purpose or objective of each activity. The re- 
searcher depicts much as a painter depicts: he attempts to discover the 
salient elements in the situation and then to portray them in their appro- 
priate relationships and contexts. The developer depicts not to portray 
the process but to monitor it, to discover problems in their still incipient 
stages and thus to be able quickly to counteract them. 

The researcher tests in order to verify or refute his hypotheses. It is im- 
perative in his testing that he maintain rigorous control over all elements 
so that only those that enter specifically into the hypotheses can interact. 
It is in this way that we investigate the law of gravity for example, and 
can show, under conditions of a vacuum, that a feather and a stone do 
indeed fall at the same rate. Thus we establish universal laws. The de- 
veloper is not concerned with controls, however. He does not need to 
know what happens to a stone and a feather under idealized conditions 
but in the real world. When he develops a solution to a problem it must 
be clear that it will work not only in the best of all possible worlds in 
which everything irrelevant can be constrained but also in the worst of 
all possible worlds in which everything irrelevant is free to contaminate. 
We shall return to this problem in our later discussion of evaluation; for 
the time being let it suffice to demonstrate that the testing of the researcher 
is not different just in degree or time from the testing of the developer 
but in fundamental intent. 

Diffusion 

The activities in which a diffusion agent, or diffuser, engages are those 
that are involved in bringing a proposed problem solution or invention 
to the attention of someone who may actually use it in practice, and those 
involved in giving that practitioner the opportunity to assess the operating 
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qualities of the invention. A taxonomy appropriate to this range of activ- 
ity is shown in Figure 4. There seem to be essentially six ways in which 
the diffuser may operate: 

Figure 4 
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1 • H e can teU. Telling involves the word. The word may be written, as 
in newsletters, papers, monographs, books, articles, and the like; or it 
may be spoken, as in conferences, speeches, conversations, etc. My essen- 
tial diffusion mode today is, obviously, telling. 

2. He can show. Showing is a form of communication which involves 
a direct confrontation with the phenomena of interest, as in a planned or 
casual observation, or in actual participation. It may involve structured 
experiences such as demonstrations or simulations; or it may involve 
looking at materials or displays such as pictures, slides, films, dioramas, 
realia, and the like. 

3. He can help. Helping consists in the direct involvement of the dif- 
fuser in the affairs of the practitioner but on the practitioner’s terms. 
It may take the form of consultation, service, trouble-shooting, and the 
like. 

4. He can involve. Involving takes the form of an inclusion or coopta- 

tion of the practitioner. Thus the diffuser may enlist the practitioner in 
assisting with the development, testing, or packaging of an innovation; 
in acting as a “satellite” or agent to diffuse the invention to others; in 
contributing the problems to which innovative solutions are to be sought • 
and the like. & 

5. He can train. Training takes the form of familiarizing practitioners 
with the features of the proposed problem solution or invention, or of 
assisting them to increase their skills and competencies or to alter their 
attitudes. It may be accomplished through formal university credit 
courses, institutes, workshops, internships, apprenticeships, extension 
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courses, local in-service training, “T-group sessions,” and similar experi- 
ences. Training may involve telling, showing, helping, and involving but 
differs from these other techniques in that the practitioner makes a formal 
commitment to learn by allowing himself to be trained. 

6. He can intervene. Intervening consists in the direct involvement of 
the diffuser on his own terms, not those of the practitioner. It may take 
the form of mandating certain actions (e.g., adopting a statewide text- 
book) , inserting certain control mechanisms (e.g., instituting a statewide 
testing program), or of intruding certain economic or political factors 
(e.g., arranging the purchase of language laboratory equipment or caus- 
ing board dismissal of an uncooperative teacher) . 

The reconstructed logic of the diffusion process is thus as follows: The 
diffuser has the task of building awareness and understanding of an. in- 
vention and causing practitioners to consider its features with a view to 
possible application. To discharge this function he has essentially six 
techniques at his disposal: telling, showing, helping, involving, training, 
and intervening. He will use any combination of these techniques to cause 
favorable consideration without resorting to hucksterism or unethical 
manipulation. He sees himself as a person opening viable professional 
alternatives to the potential adopter with a problem to solve. 

Adoption 

The purpose of adoption activity is to shape and install a problem solu- 
tion or invention within a particular local setting. This phase seems to 
have received little conceptual attention from anyone; it is perhaps the 
most muddy of the four. It seems to me that at least three major «teps are 
involved, with the second of these being divided into several si b-steps 
(Figure 5) as follows: 



Figure 5 
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1. Trial. No prudent administrator will permit the installation of a 
proposed problem solution on a permanent basis without having convinced 
himself that it will perform as claimed. Indeed, a local trial is mandatory 
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even when national assessments have indicated that the solution performs 
well on the average, for the obvious reason that the situation in wliich 
installation is proposed may not be average. Local variations must be 
taken into account. 

2. Installation. When a proposed solution has proved itself through a 
local trial, it then becomes necessary to arrange for its installation on a 
building-wide or system-wide basis. At least four areas of concern must 
be attended to: 

Modification. No invention will fit exactly into a local school situa- 
tion for which it was not explicitly designed. Decisions will have to be 
made whether the fit can best be accomplished by modifications in the 
invention itself or in the school situation. If for example the invention 
requires teachers with particular skills but teachers with these skills 
are simply not available, some modification in the invention will be 
required. 

Training. Personnel expected to use the invention must be trained. 
No teacher will willingly risk his reputation before a class with a tech- 
nique about which he is unsure. More importantly, no administrator 
should be willing to permit a teacher to adopt a new technique without 
proper training for use, lest through lack of knowledge he should fail 
to take full advantage of whatever additional benefits are expected to 
accrue. 

Facilities. Many inventions require particular kinds of physical ar- 
rangements. Typically a school adopting such an invention will not be 
suitably housed for the purpose or may not possess appropriate equip- 
ment. Flexible scheduling or multiple-size grouping cannot occur in a 
building arranged for conventional size classes of 25 or 30. 

Administration and organization. The proposed invention may have 
important administrative or organizational consequences. Problems in 
scheduling, in budgeting, in staffing, in organizing may all produce 
headaches for the administrator. Unless these possibly disruptive con- 
sequences can be foreseen and obviated, the result may be a failure of 
an otherwise useful invention. 

3. Institutionalization. Ultimately the invention must be assimilated 
into the ongoing program. At some time it must cease to be viewed as new 
and must become an integral and accepted component. It is not clear to 
me what steps might be taken to insure institutionalization* Sometimes I 
feel that the most important factor may simply be the passage of time. 
Obviously, the lack of awkward incidents in relation to the invention is 
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helpful and the more quickly the spotlight can be taken off of it the more 
quickly it is likely to become accepted. 



How Are We Doing on Bridging the Gap 
Between Research and Practice? 

In .ny preceding remarks I have attempted to illustrate the fact that 
there is a large gap between knowledge production and utilization, and I 
have attempted to depict the flow of knowledge from initial research into 
final use in terms of a four-category continuum. Our concern at this con- 
ference is primarily with the middle two categories, development and 
diffusion, for they represent the projected means for bridging this gap. 
I would like now to turn briefly to a consideration of what we are doing, 
and how well, in operationalizing these two categories. 

I will, therefore, not make any further lemarks about either research 
or adoption. I do feel compelled to observe, however, as we leave these 
categories behind, that my lack of attention to them does not indicate any 
high degree of satisfaction on my part with the way research and adoption 
activities are operating. Indeed, it is well known that research results are 
not being utilized to any great degree in educational practice, and that 
almost no attention has been paid either conceptually or practically to the 
problems of adoption which I briefly outlined above. But my concern 
today is with the bridge and not with the abutments, although I hope that 
due attention will be paid lest we mount cur bridge of steel on banks of 
sand, when the time comes. 

Let me turn then to a more detailed consideration of development and 
adoption. 

Development 

Development is a very complicated process which neither practitioners 
nor researchers are particularly competent to carry out. If there is any 
area in education that calls for reorganization and for the evolution of 
new professional roles, this is certainly it. Experience from industry in- 
dicates that from five to eleven times as much investment is required to 
develop an application from a research finding than was necessary to 
produce the research finding in the first place. High level specialists are 
required to do the job. Moreover, development depends not only upon the 
availability of relevant basic research but upon a host of other factors 
as well: the availability of resources, institutional support, experience, 
practical judgment, political factors, and the like. Research data provide 
only one of several critical inputs, and the blending of these inputs re- 
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quires more specialized skill than either researchers or practitioners com- 
monly possess. 

Initial attempts at development in education occurred gradually and 
without a clear realization of what was happening. I am sure that the 
persons following the lead of Jerrold Zacharias in the development of the 
PSSC physics materials were scarcely aware of what a vanguard group 
they were. The several other curriculum development groups, mainly 
funded by the National Science Foundation in those early days, were 
certainly more interested in updating content than they were in establish- 
ing development patterns which others might emulate. But their pattern 
did seem to prove successful, and it was soon emulated, particularly in the 
new course content improvement projects of the U.S. Office of Education. 

In more recent years we have seen further systematic attempts to estab- 
lish development agencies. Clearly the research and development centers 
have a mandate to turn their research into practice. But as we have seen, 
successful development involves a great deal more than the mere avail- 
ability of relevant research. We may well wonder therefore whether the 
primarily research-oriented R & D centers will be up to the task. Another 
similar effort has occurred, in the establishment of the regional educa- 
tional laboratories, which are mandated to identify and solve educational 
problems, hopefully through recourse to research but by other means if 
necessary. Thus far the laboratories are too new to make it profitable to 
venture a judgment about their probable level of success. 

It seems that no existing agencies have responsibility for the full range 
of development activities indicated by the taxonomy presented earlier. 
Ilie depicting function seems to be especially neglected. While both re- 
gional laboratories and Title III projects were mandated to make needs 
surveys of their regions, it is clear that these surveys were carried out in 
a most perfunctory way, and without the benefit of hard data in many 
cases. (I should note at once that this is not the fault of the agencies in- 
volved no much as it is of the Office of Education, which mandated these 
surveys under incredible constraints of time and resources.) More im- 
portantly, even when well done, these surveys provide but a static “snap- 
shot” of the situation at any moment rather than a dynamic “motion pic- 
ture film 1 ’ over an appreciable time span. 

The invention function is perhaps better managed than the others, 
although certainly not nearly as well as it should be. Funds are available 
for improvement projects and several agencies, including the new indus- 
try-education combines as well as the regional laboratories and research 
and development centers, are beginning to undertake massive improve- 
ment projects. Yet a conceptual underpinning for such activity is still 
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missing. We still know far too little about effective ways of creating new 
solutions or even of transmitting, translating, or transforming known 
solutions. 

Fabrication will probably be handled best by the industry-education 
combines, since these typically involve publishers and manufacturers of 
hardware that can be used to good effect. The publishing industry has 
shown a great deal of ingenuity in the past in placing its materials into 
interesting and novel formats and will probably continue to do so. 

In the area of testing we come again upon a quite underdeveloped area. 
We shall see later that existing evaluation designs do not seem to be too 
appropriate for the real problems of education. We may also be concerned 
that if much of the fabrication is carried on by commercial agencies, they 
may be over eager to rush their faorications into production without the 
kinds of testing that would assure a professionally warrantable product. 
Thus both conceptual and consumer protection innovations are needed in 
the area of testing. 

From one point of view, then, the development picture is not too rosy. 
When one considers, however, how late in the day we determined to un- 
dertake development at all, and with what meagre resources we have 
supported it, we may perhaps be forgiven if we take a more charitable 
view. Now that education is fully aware of the need for development 
activities, is apprised of their complexity, and is being aided with re- 
sources to get development activity started, we may hope that within a 
decade most of the problems I have enumerated will have disappeared. 

Diffusion 

Diffusion is an activity regarded with some distaste by many members 
of the educational establishment, particularly the research community. It 
is often equated with hucksterism, and I suppose, in fairness, that one must 
concede that a great deal of hucksterism does take place. This fact may 
be the best argument one can muster in favor of well organized diffusion 
efforts, however, so that one can be sure that what is being diffused is a 
viable alternative rather than just another fad. 

Traditionally educational diffusion has fallen within the domain of 
commercial interests, mainly the book publisher. Recently both research 
and development centers and regional educational laboratories were given 
some diffusion responsibilities, and these agencies have begun to develop 
new approaches, although haltingly. 

The major diffusion responsibility seems to be falling squarely on the 
shoulders of Title III projects. There is a school of thought that suggests 
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that research and development centers should be concerned with research, 
regional educational laboratories with development, and Title III projects 
with diffusion. This is a formulation with which I am in essential agree- 
ment, perhaps because this division of labor would fit my earlier model 
so well. There would be at least three of the change stages, then, for which 
institutional responsiblility would be firmly fixed. This formulation also 
seems to be supported in the Office of Education. 

But whatever our view may be about the appropriate institutional ar- 
rangements for carrying out the diffusion function, it is clear that that 
function has not to date been carried out very well. In my own opinion 
the major reason for this failure may be traced to our earlier failure to 
delineate acceptable strategies for diffusion. I use the word strategy to 
indicate an action plan which indicates which of the adoption techniques 
outlined in the earlier adoption activity taxonomy should be used when 
and where and in what combination. To evolve such a strategy seems to 
me to imply some consideration of at least the following elements: 

1. Assumptions concerning the nature of the practitioner who will be 
exposed to the strategy . The practitioner may be viewed as a rational 
entity, who can be convinced, on the basis of hard data and logical argu- 
ment, of the utility of proposed invention; as an untrained entity who 
does not know how to perform but who can be taught; as a psychological 
entity who can be persuaded; as an economic entity who can be compen- 
sated or deprived; as a political entity who can be influenced; as an entity 
in a bureaucratic system who can be compelled; or as a professionally 
oriented entity who can be obligated. We might term these respectively 
as rational , didactic , psychological , economic , political , authority , and 
value assumptions. Obviously the ways in which the earlier outlined tech- 
niques are used will depend heavily on which assumptions one makes. 
Therefore, telling, showing, training, etc. will certainly be different if 
one assumes a rationally oriented subject, i.e., one who will be convinced 
by facts, than if one assumes a politically oriented subject, i.e., one who 
can be manipulated. 

2. Assumptions concerning the end state in which one wishes to leave 
the practitioner. Very little attention is typically paid to the question bf 
the end state in which the diffuser wishes to leave his subject. This situa- 
tion may arise, of course, because the diffuser may act as a mere huckster; 
hucksterism may “sell” a particular invention being promoted but it may 
leave the practitioner with very little residual propensity ever to consider 
any other proposed invention. But even with “well-intentioned” diffusers 
this difficulty may arise because of a basic failure to consider desirable 
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end states. What is it that the practitioner should be able to do, think, or 
to feel as a result of having been exposed to a diffusion strategy? Is he 
to be better trained? More skillful? More knowledgeable? More open? 
Wiser? Obviously the choice of a diffusion strategy would be consider- 
ably aided by careful attention to this factor. It seems particularly ironic 
that this situation of carelessness about end states should hold true in the 
field of education, which is so generally characterized by concern about 
behavioral outcomes and objectives. If we applied a little of our usual 
logic about specifying expected goals this difficulty would be largely 
overcome. 

3. Assumptions about the nature of the agency or mechanism carrying 
out the diffusion activity. No sensible diffusion strategy can be evolved 
without careful attention to the matter of who is to carry it out. For not 
all strategies are within the capabilities of all agents or mechanisms. 
Constraints exist which mandate certain actions for certain agents and 
which prohibit other actions to them. So for example, a regional educa- 
tional laboratory, acting as a diffusion agent, is hardly in a position to 
intervene, since it lacks the necessary power or authority to do so, but 
telling, showing, or involving come “naturally” to it. A state department 
of education may well intervene (and indeed may be legally mandated 
to do so) but would probably be very suspect if it tried to involve. An 
individual teacher can tell and show but probably would be thought 
ridiculous if she set up a training experience for her fellows. A university, 
however, could carry out this latter function with impunity. Since the 
final implementation of the strategy depends upon the agent, the strategy 
must be one appropriate to the agent’s circumstances. 

4. Assumptions concerning the substance of the invention. Obviously 
not all inventions are alike; they pose different problems of adoption, 
and this fact must be taken into account in developing an appropriate 
diffusion strategy. One way to view this situation is in. terms of the 
amount of change mandated by the invention. Thus Chin (1963) charac- 
terizes innovations as involving substitution , alteration (a minor change) , 
perturbations and variations (mere changes in organizational equilib- 
rium), restructuring (requiring reorganization), and value orientation 
change (deep-seated value changes). Rogers (1962) talks about charac- 
teristics of inventions that make them more or less acceptable, including 
relative advantage (intrinsic superiority), compatibility (consistency 
with existing values and experience) , complexity (difficulty in use) , divis- 
ibility (degree to which the invention can be partitioned and/or tried on 
a limited basis), and communicability (or diffusability) . Whether these 
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or other ways of classifying the substance of innovations are most useful is 
less important for us at the moment than that there be some explicit way 
for taking account of substance at the time that a diffusion strategy is 
devised. 

We are thus confronted, in considering diffusion, with a picture that 

is, if anything, even less satisfying than that presented by development, 
which we reviewed earlier. There seems to be a considerable confusion 
about the organizational responsibilities that may exist in this important 
arena, with attempts to develop viable organizations being so recent as 
to invr ate any attempts at judgment at this time. Further, theory and 
practice are both relatively silent on the important issue of how diffusion 
strategies are best devised. All we seem to be able to do at this time is 
to point to the important factors that probably ought to be considered. 
However, as in the case for development, when one considers how re- 
cently this concern has emerged and how new are our efforts to deal with 

it, we may perhaps be willing to take a more long range view. 



Evaluation 

Thus far I have said very little about evaluation, which you may have 
considered rather remarkable in view of the fact that the term appears 
in the title of this paper. I wish to remedy that defect now. Evaluation 
is sc important and so pervasive a concept when we think about closing 
the gap between knowledge production and utilization that it deserves 
quite detailed and separate attention. 

I shall have two major points to make about it: (1) The concept of 
evaluation is changing rapidly, becoming in particular much more perva- 
sive than has traditionally been the case, and (2) The methodologies cur- 
rently in use for evaluation are hopelessly bad and urgently need 
replacement. 

Let me begin with some observations about what has in the past been 
meant by evaluation. Typically two complementary operations are de- 
noted by the term: (1) the comparison of some results, output, or product 
with a set of standards, in an absolute sense; and (2) the comparison of 
some two or more methods of producing the same results, output, or 
product, in a relative sense. In the first case the standards were usually 
derived in relation to some objective. Thus, the objective might be to 
develop reading skill, and the standard might be the 4.0 grade equivalent 
on the Stanford Reading Achievement Test. Pupils could then be judged, 
in an absolute sense, on their achievement of that objective. Or two 
methods of teaching reading skills might be judged to determine which 
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produced a higher average reading skill level in two groups of pupils, in 
a relative sense. 

Measurements taken to carry out these classic forms of evaluation are 
usually of the pre- and post-test type, depending upon one’s preoccupa- 
tion with initial status, group equivalence, and similar matters relating 
to control or data analysis. The term bench mark is frequently used to 
describe collection of initial status data. Between collection of bench mark 
data and final performance data a long period, say a semester o* school 
year in length, could and usually did intervene, during which data might 
or might not be collected but during which stringent controls are main- 
tained so that the data will not be confounded. In particular great care 
is taken not to alter any essential element related to the method, technique, 
or content being evaluated, lest the change render the evaluation invalid 
(one could not tell what was being evaluated). Generally speaking the 
traditional rules of experimental design and field control are rigorously 
invoked. The essential task of traditional evaluation is to judge. 

Emergent evaluation however is seen as a tool to aid in decision-mak- 
ing. The tasks of (I) identifying an educational problem or need, (2) de- 
vising or selecting a treatment to cope with it, (3) implementing the 
treatment procedures, and (4) determining the treatment’s feasibility, 
quality, effectiveness, and efficiency require a series of decisions which 
evaluation can aid. The process of collecting and interpreting data rele- 
vant to this series is seen as the substance of evaluation. 

Daniel Stufflebeam (1967) of the Evaluation Center at The Ohio State 
University seems to me to have come closest to defining the new evalua- 
tion when he talks about four kinds of evaluative activity. The first of 
these is context evaluation , which, in the setting of the school, means the 
continuous determination of the school’s status on key variables with a 
view to identifying needs and problems. Such an evaluation gives the 
decision-maker data he needs to have about important directions in which 
he should move. Second, there is input evaluation , which is concerned 
with assessing various possible responses to the needs or problems that 
may exist. There are probably a number of ways, for example, in which 
a school principal might revamp his reading program to take account of 
the special problems posed by culturally disadvantaged children; which 
of these ways has the highest payoff potential in his situation? Third, we 
need to be concerned with process evaluation , which is used to determine 
whether the selected input is working as it was expected to and which, 
even more importantly, provides for continuous feedback so that the se- 
lected input can be continuously refined and adjusted to better achieve 
its intended purpose. Finally, there is product evaluation, which is most 
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like what we have traditionally meant by evaluation, i.e., the detenr {na- 
tion of the feasibility, quality, efficiency, and effectiveness of the input in 
responding to the need or problem involved. 

It is interesting to check the terms of this analysis against the terms 
listed in the taxonomy of development presented earlier. What Stuffle- 
beam calls context evaluation is of course very similar to what 1 meant 
by the term depict , i.e., a continuous assessment of the situation. We 
might note the similarity of this concept of continuous assessment to the 
older concepts of bench mark or base line, but while these latter are static 
concepts indicating status at some point in time like a snapshot, the con- 
tinuous assessment idea is rather like a dynamic bench mark or base line, 
giving, as it were, a continuous motion picture film of what is going on. 
Needless to say attempts at continuous assessment pose some interesting 
methodological problems. 

Next, it seems clear that Stufflebeam’s idea of input evaluation has 
relevance at what I have called the “invent” stage of development. In 
order to determine, for example, whether the invention problem is one of 
transmitting, translating, or transforming existing solutions, of synthe- 
sizing new solutions from available elements, or of creating a solution 
de novo, some assessment will be required of possible inputs and their 
probability of useful payoff. 

Finally, when a solution has been fabricated, it must be tested, and 
it is clear now that testing should involve both process and product 
measures. It is likely that the solution will not be in near-perfect form 
when it is first applied in a real context; hence continuous improvement 
is mandated. Process evaluation allows for this contingency Further, we 
need to be sure that the solution is being applied in a form reasonably 
similar to the one its fabricators had in mind; again, process evaluation 
to the rescue. And of course we want to be sure that the solution does 
in fact achieve its objectives; i.e., meeting the need or responding to the 
problem. And here we have product evaluation. 

Needless to say, we are a long way indeed from having the techniques 
necessary for applying evaluation in the way indicated by this analysis. 
These concepts are only now emerging, and it will take a long time before 
we are able to apply them systematically in operational situations. But it 
is clear that traditional concepts are no longer good enough. 

The shortcomings of traditional evaluation can be documented in other 
ways than through such a theoretical analysis, however. We need only 
to look at the large mass of “no significant difference” findings typically 
produced by evaluation studies to begin to wonder about the power of the 
techniques, particularly when all the evidence of the senses of participants 
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argues that there is a difference. Or consider the conclusion of the widely- 
publicized Coleman report (1966, p. 235), which asserts, after a most 
careful and thorough examination of all available data, that there is only 
a . relatively small amount of school-to-school variation that is not 
accounted for by differences in family background, indicating the small 
independent effect c f variations in school facilities, curriculum, and staff 
upon achievements.” 

This conclusion is simply incredible on its face. It means, if true, that 
it makes no difference whether a teacher is good or bad, whether good 
or poor materials are available, whether the school is a bam or a geodesic 
dome, students will learn about the same (and not much at that!). Now 
anyone who has spent any time at all in a school knows that is just not 
so; why then do our evaluative techniques not pick this up? 

I believe it can be argued that traditional evaluation has four charac- 
teristics which account for its sharply limited utility. These include termi- 
nal availability of data , retrospective view , imposition of constraints , and 
limited generalizability „ 

1. Evaluative data are usually available only upon the termination of 
the evaluative period. Hence they can provide information relevant only 
to “go,” ‘"no-go,” or “recycle” decisions about the treatment being evalu- 
ated. Other kinds of decisions cannot be served. 

2. Evaluative data typically afford only a retrospective view. The eval- 
uation does not provide information during the test of the treatment 
which might have been used to improve it. 

3. The assumptions on which evaluative designs are based (those of 
traditional experimental design) impose a. series of constraints on the 
evaluator. There can be, for example, no variation in treatment or context 
once the evaluation is under way, since this would result in the confound- 
ing cf critical variances. Thus traditional evaluations militate against any 
concurrent effort at improvement of the treatment and against other con- 
textual changes, e.g., the introduction of any other innovation, during the 
term of evaluation. 

4. The constraints imposed because of the requirements of classical 
experimental design in effect create a laboratory condition within which 
the treatment will be tested. The many sources of variation found in the 
real world are deliberately excluded from having any effect upon the 
outcome. The evaluation describes what happens under laboratory cir- 
cumstances, and not under “typical” circumstances. The generalizability 
of the findings is thus necessarily limited. 

The problem of constraints is an especially interesting one and prob- 
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ably deserves some special comment. Generally speaking, the constraints 
arise because of a variety of assumptions that must be made to support 
the logical and statistical structure of design theory. Three general classes 
of assumptions may be identified: 

1. Statistical assumptions. Statistical assumptions support the develop- 
ment of the statistical techniques for analyzing and interpreting data. 
There are certain assumptions necessary to know that a distribution is 
normal before one can assert that 68 per cent of the cases are included 

in the interval X ± s. Other assumptions are built into the derivation of 
the interpretive tables in which the “significance” of analytic statistics 
is read; thus the derivation of the F distribution depends upon assump- 
tions of random sampling from a population in which the variable of 
concern is normally distributed. Finally, still other assumptions are neces- 
sary to support the logic of an analytic method. Thus, in the case of 
analysis of variance (and other tests of significance), the additivity as- 
sumption which asserts that treatments have equal effects on all persons 
to whom they are applied, is vital. For unless this assumption is met, 
group variances change and the basis for computing an error term 
disappears. 

2. Design assumptions . A second class of assumptions has to do with 
the logical requirements of design procedures. Typically, in an experi- 
ment, the effect of some treatment is to be determined. A group exposed 
to the treatment cannot simply be measured to determine that effect, for 
the obvious reason that there exists no “bench mark” against which to 
assess that measurement. If the bench mark is provided by simply making 
a second (earlier) measure on the experimental group, the difference 
may still be called into question as having been caused by other extrane- 
ous (confounding) effects such as history, maturation, and the like. A 
second group, the control group, is usually added to obviate this difficulty. 
But the second group is useless unless it is comparable to the first, because 
design procedures have been worked out on the assumption that such 
comparability exists. The function of the assumption of comparability is 
to protect the internal validity of the experiment. 

But external validity (generalizability) may be threatened also. First, 
we need to be certain that experimental and control groups were in fact 
selected in some way which guarantees their representativeness of the 
population to which the results are to be generalized. Under ideal circum- 
stances such representativeness can be guaranteed only by both random 
selection of subjects from the population and random assignment of the 
subjects to the experimental and control groups (random selection and 
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assignment would of course also guarantee comparability). Then, we 
must protect the groups against reactive or interactive effects that would 
alter the groups in some way during the experiment so that their repre- 
sentativeness would be duhious. 

Thus, design theory as it is now explicated requires compatibility to 
protect internal validity, and random selection , random assignment , and 
reaction-interaction control to protect external validity. 

3. Treatment assumptions. Statistical and design assumptions are quite 
well understood because these assumptions had to be made explicitly in 
order that the statistic or the design could in fact evolve. Less well under- 
stood are the implicit assumptions made about the treatment whoso 
,'ffect is to be tested. It must be assumed that the treatment if fully expli • 

* 'd a priori. It must be assumed that the treatment can be “plugged into” 
experimental setting with no interactive effect with other elements. 
‘A * - treatment must further be invariant throughout (else the variances 
re onfounded) and must be applied in identical ways by all persons 
responsible for its trial. Finally, it must be the case that there are no 
competing treatments, for if such competing treatments exist their indi- 
vidual effects cannot be separated. 

All of these assumptions are in some particulars unrealistic for educa- 
tion. Among statistical assumptions, for example, the additivity assump- 
tion is especially inappropriate; every experienced teacher knows that 
effective teaching will increase the variance of ithe group being taught, 
and usually markedly. Among the design assumptions the comparability 
problem is especially sticky. Usually comparability cannot be managed 
directly. So an indirect process, such as locating schools with similar 
buildings, similar socio-economic backgrounds, similar intelligence levels, 
etc., is used. Such procedures may or may not solve the comparability 
issue, but they certainly do destroy external validity, at least to the extent 
of limiting the generalizability of the findings to similar restricted groups. 
Finally, among the treatment assumptions, treatment invariance is not 
only quite difficult to achieve, but may be undesirable, since the treatment 
may be one that could profit from continuous improvement even while 
being tested. 

This analysis has led me to the conclusion that some new evaluation 
strategy free of the defects that I have enumerated is necessary before 
evaluation as a science can make its next major strides. Of course no 
such strategy exists at the moment, but it is possible to indicate certain 
characteristics which it must have if it is to be successful: 

1. Level of control. Typical experimental controls must be eliminated. 
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The evaluator must be concerned with how things occur in the field rather 
than in the laboratory. Hence the kind of control that we have been ac- 
customed to in laboratory experimentation will be sharply different, per- 
haps non-existent. 

2. Non-intervention. The evaluator cannot arrange the inquiry situa- 
tion but must accept it as it occurs. Data collection must be carried on in a 
non-intervention mode, i.e., without disturbing either the context or the 
subjects. 

3. Continuity of data collection. Data are not collected simply at pre- 
and post-experimental periods (or at some particular check points) but 
continuously throughout the evaluation. The baseline of data must be 
dynamic rather than static. 

4. Treatments. Treatments cannot be regarded as invariant but as 
susceptible to continuous change (improvement). Context conditions 
must also be alterable. 

5. Scope. Attention must be given not only to particular variables 
which have been identified and operationalized beforehand, but to any 
emergent variables which appear to be of concern. 

6. Assumptions. The evaluation system cannot be cause to conform to 
traditional assumptions, but rather the assumptions must be formed to 
meet the reality of the situation. It is only on such reality-oriented as- 
sumptions that a useful theory of evaluation can be based. 

Conclusion 

Well, as you can see, I haven’t learned much over the last decade; I am 
still playing the old nomothetic-idiographic game in a new guise. How- 
ever spariding my ideas may be, they certainly do not provide very much 
operational guidance. But that is exactly the problem I have tried to deal 
with, and this presentation is as good an example as any of the fact that 
there is an enormous hiatus between theory and practice. 

Whether you agree with my particular formulations or not interests me 
less than that you agree that there is a problem of fantastic proportions 
confronting us. It is a problem that will not be solved without a great deal 
of attention to emergent roles and organizations. We have made some 
strides on the problem of organizations, as witness the new agencies and 
programs that have emerged as a result of the passage of ESEA. On the 
personnel problem we are still far behind; so far as I know there is no 
program in existence anywhere making a concerted effort to train the 
range of middlemen that will be required. Indeed, we are still lacking 
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even a primitive formulation of the roles that should be created. We cer- 
tainly do not know where we shall recruit the persons who will ultimately 
fill those roles. We have no materials with which to train them. 

Where shall we turn for responsible leadership? It seems to me that 
leadership must, at this moment, come from the two existing establish- 
ments that are necessarily most concerned about the gap — the educational 
researchers , who stand at one end of the knowledge production-utiliza- 
tion continuum, and the educational administrators , who stand at the 
other end and who bear the responsibility for effective practice. Neither 
group, I am convinced, can do this job alone, and neither group ought to 
attempt to do it alone. But both groups must cooperate to get things 
started. 

I don’t know how the initial step should be taken. Perhaps a national 
commission of researchers and administrators should be appointed, with 
or without the blessing of the U.S. Office of Education. Perhaps AASA 
and AERA should combine in this venture. Perhaps university faculties 
in these two areas should develop joint programs for the training of 
middlemen. Perhaps UCEA can serve as an appropriate forum. Whatever 
the route, the action must come soon, for the need is great. 
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CHAPTER 

4 



Dissemination and 
Translation Roles 



Introduction 

Any detailed consideration of the dissemination and utilization of 
knowledge must sooner or later focus on the question of linking roles. 
Who sees to it that knowledge gets to the user? Who is charged with the 
responsibility of retrieving basic or applied knowledge, deriving practical 
implications from it, and distributing it to people who need it and can 
use it? 

A natural starting point for a discussion of linking roles is a birds-eye 
view of what is often termed <4 the knowledge gap” : the situation for which 
linkage is required. Figure 1 depicts this gap: the two enclosures repre- 
sent two social systems each defined and identified by its own set of rules, 
values, languages, and communication patterns. Those norms which are 
shared within each system also define their separateness from each other. 
There is an inadequacy of shared values, common perceptions, and inter- 
system communication patterns. 



figure 1 

« 

Ronald G. Havelock is Project Director , Center for Research on the 
Utilization of Knowledge^ University of Michigan. 





64 



Ronald G a Havelock 



65 



The linking role argument is that this gap can be bridged effectively if 
additional persons or groups are interposed between the two systems as 
in Figure 2, these additional intermediaries being specialists in the 
process of linking itself. 



Figure 2 



Researcher^^) < — Linker Practitioner^^ 



The basic question is whether linking roles are really necessary or 
whether it is preferable for knowledge builders to pass their findings di- 
rectly to potential users, bypassing a middleman who would translate 
(and oossibly distort) the researcher’s knowledge. There is no easy 
answer to this question, but in the presentation which follows we will 
try to address ourselves to it. We will try to show what all the components 
of the H iking function are, and with that understanding we will return to 
ask again whether linking roles are necessary. 

This paper will begin with a review of the various roles which seem to 
serve the primary function of knowledge linking. Following this review, 
these same roles will be cast in their institutional context with consider- 
ation given to the institutional barriers to knowledge flow both on the 
knowledge builder and knowledge user sides and to the institutional ar- 
rangements which facilitate the linker’s activities. The presentation will 
conclude with a summary analysis of what appear to be the endemic 
problems in the linker concept and some thoughts about how it ought 
to be developed in education. We will endeavor to be practical, indicating 
what types of linking roles seem to be most suitable and effective for 
what finking tasks, what characteristics and skills need to be considered 
in recruiting ai d training linkers, and what kind of institutions need to 
be created to secure these roles and to make knowledge linkage an em- 
bedded feature of our national educational system. 

A Typology of Unking Roles 

One of the first facts of which we should be aware when we discuss link- 
ing roles is that there are a great variety of roles which could be said to be 
linking in one way or another. Indeed, connected to every phase, every 
aspect, and every problem in the dissemination and utilization process, 
one could conceptualise a specific role — someone responsible for retriev- 
ing knowledge from basic research, someone responsible for identifying 
new innovations in practice, someone responsible for writing handbooks 
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and producing packaged knowledge for potential clients of various sorts, 
and so forth. The range of such roles is suggested by some recent attempts 
to classify them. A well-known typology current in education is that 
developed by Clark, Guba, and Hopkins in a number of recent articles, 
e g., Clark and Hopkins (1966) . They have posited a sequence of inter- 
related roles which correspond to various stages in a research, develop- 
ment, and diffusion sequence. Under “development” they include roles 
for “inventing,” “packaging,” and “evaluating,” while under “diffusion” 
they list “informing,” “demonstrating,” “training,” and “servicing” or 
“nurturing.” Another educator (Hencley, 1967) offers a “taxonomy” of 
research and development roles which includes “quality controllers,” 
“social bookkeepers,” “design engineers” and “researchers who concen- 
trate on diffusion.” One could go on to other theorists and taxonomists in 
education and other fields to find similar lists. Each list has its own 
special logic and its own special elegance. It is, therefore, with consider- 
able trepidation that we set out to compile our own typology, piecing to- 
gether from diverse sources those concepts pertaining to linking roles 
which seem to be non-redundant and conceptually additive or integrative. 

A cautionary note may be in order before we proceed, however. As in 
any classification, the “types” offered here are all somewhat fictional, 
something on the order of “ideal types.” When we look at the linker 
in vivo we find that he is a mixture, playing several linking roles in se- 
quence and simultaneously and indeed sometimes not playing the linker 
at all. 

Here, then, in Table 1 , is a typology of linking agents drawn from a 
wide spectrum of sources across many fields of knowledge, and grouped 
under major headings which suggest their most salient functions or the 
assumptions about the transfer process which each set seems to imply. 

The conveyor 

The most rudimentary and simplistic linker concept is the “conveyor” 
(Havelock, 1967) or “carrier” (Jung, 1967), one who takes knowledge 
from expert sources and passes it on to non-expert potential users. The 
“knowledge,” of course, could be in the form of research data, informa- 
tion derived from research, “packaged” knowledge derived generally 
from scientific knowledge in the form of curricula, printed materials, and 
training programs, or it could be supplies, products, services, or practices 
founded on or derived from scientific knowledge in one way or another. 
The pure conveyor concept suggests that such knowledge is passed on 
pretty much in the form that it is received. It seems doubtful, however, 
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Table 1 

KNOWLEDGE LINKING ROLES 



ROLE TYPE 


FUNCTION 


FIELD 


EXAMPLES 


SAMPLE REFERENCES 


Conveyor 


To transfer knowledge 
from producers 
(scientists, experts, 
scholars, developers, 
researchers, manufac- 
turers) to users 
(receivers, clients, 
consumers) 


Agriculture 


County agent 
(especially as 
seen by others) 


Wilkening (1958) 
Abraham (1962) 




Agriculture 


Extension 

Specialist 


Brown and Deekens 
(1958) 




Agriculture 

Medicine 


Salesman, 
retailer, drug 
detail man. 


Elliott and Couch 
(1965) 

Anderson (1955) 
Bauer and Wortzel 
(1966) 






Psychology 


Science 

reporters 


Wood (1962) 






Education 


Trainer. 'j Dj . T Clark and Hopkins 

Informers f (,966) 

DemonstratorsJ aTO ' 8 J 






Education 


Teacher 








Gov. Policy 


Scientific 

expert 


Moulin (1962) 
Schilling (1962) 
Sponsler (1962) 
Geiserson (1965) 






Industrial 

R&D 


Systems 

engineer 


Havelock and 
Benne (1967) 


Consultant 


To assist users in identi- 
fication of problems 
and resources, to assist 
in linkage to appropri- 
ate resources; to assist 

in adantRtion to n«o« 


Various 


Mental health 
consultant 


Bowman (1959) 
Binslerman (1959) 
Berlin (1964) 
Kaufman (1956) 
Glaser (1967) 




111 quu|JImI1wII i w use* 

facilitator, objective 
observer, process 
analyst. 


Various 


Change agent 


Lippitt et at. (1958) 




Organization 


Change agent 


Schien and Bennis 
(1965) 






Education 


Change agent 


Watson (1967A) 
(1967B) 






Agriculture 


County agent 
(as he actually 
operates much 
of the time) 


Stone (1952) 
Penders (1963) 






Urban 


Expeditor 


Reiff and 
Reissman (1964) 






Psychiatry 


Legal mediator 


Tershakovec (1967) 


Trainer 


To transfer by instilling 
in the user an under- 
standing of an entire 
area of knowledge 
or practice. 


All Fields 


Teacher 








Professor of 
Practice 






Education 


Trainer 


Clark and Hopkins 
(1966) 
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Leader 


To effect linkage 
through power or 
influence in one's uwn 
group, to transfer by 
example or direction. 


Education 


Administrator: 

superintendent, 

principal 


Carlson (1954) 
Richland (1965) 
Chester et al. (1963) 




Various 


Gatekeeper 


Lewin (1963) 






Medicine 


Opinion leader: 
physician 


Katz (1957) 






Agriculture 


Opinion leader: 
"good farmer" 


Blackmore et aL 
(1955) 

Wilkening and 
Santopolo (1952) 






Community 

(urban) 


Opinion leader: 
informal power 
structure 


Angell (1951) 


Innovator 


To transfer by initiating 
diffusion in the user 


Agriculture 


Innovator 


Rogers (1962) 




system. 


Agriculture 


Demonstrator: 

farmer 


Blackmore et al. 
(1955) 

Wilkening and 
Santopolo (1952) 






Industry 


Product 

champion 


Wilkening (1958) 
Nader (1967) 






Industry 


Entrepreneur 


Wilkening (1958) 
Nader (1967) 


Defender 


To sensitize the user 
to the pitfalls of 
innovations, to mobilize 
public opinion, public 


Various 


Defender 


Klien (1967) 




Agriculture 


County agent 


Francis and Rogers 
(1960) 




selectivity, and public 
demand for adequate 
applications of scientific 
knowledge. 


Education 


"Quality 

controller" 


Hencley (1967) 


Knowledge- 
builders as 
linkers 


To transfer through 
gatekeeping for the 
knowledge storehouse 
and through defining 
the goals of knowledge 
utilization. 


Various 


Scholar: 

scientific leader 


Znaniecki (1940) 




General 

educator 








Definers of 
human values 








Various 


Futurists and 
future planners 


Wright (1965) 




To transfer through 
maintenance of a dual 
orientation: scientific 


Industry 


Applied 

researcher- 

developer 


Stein (1966) 




soundness and usefulness. ~ 


Education 


Applied 

researcher- 

developer 


Clark and Hopkins 
(1966) 



Medicine 


Clinical 

researcher 


Havelock (1964) 


Industry 


R & D Manager 


Pelz and Andrews 
(1966) 

Krugman and 
Edgerton (1959) 
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Education 


Res. coordinator 


Sieber (1966) 


Education 


Res. director 


Sieber (1966) 


Education 


Engineer 


Anderson (1961) 


Education 


Curriculum 


Clark (1965) 




developer 





Practitioner 
as linker 


To transfer to clients 
and consumers through 
practices and services 
which incorporate the 
latest scientific 
knowledge. 


All 






The User 


To link by taking 


Agriculture 


Most advanced 


Rogers \,/ 62 ) 


as linker 


initiative on one's own 
behalf to seek out 
scientific knowledge 
and derive useful 
learnings there from. 




farmers 


Havelock and 
Benne (1967) 



that anyone in a linking role performs in such a limited capacity. Perhaps 
the salesman comes as near to this pure linking role as anyone, taking 
from the producer a fully developed, fully packaged, and fully usable 
product and placing it in the hands of the user. There is very little ques- 
tion that salesmen in all fields play important knowledge linking functions 
(Abell, et al., 1957; Bauer and Wortzel, 1966; Elliott and Couch, 1965; 
Stein, 1966; Wilkening, 1956). Even the salesman, however, may be 
helping the user in a more complex manner than is usually conceived. 
The drug detail man may give the doctor samples and literature of various 
sorts and he may, in addition, tell him what drugs Dr. X in the next town 
is ordering (Bauer and Wortzel, 1966). The grain elevator operator 
(Elliott and Couch, 19*5) may pick up items from agriculture experiment 
station bulletins so he can pass on useful bits to farmers and thereby 
develop firmer ties of friendship and respect. 

Another role which may come close to the pure conveyor type is the 
extension subject matter specialist in agriculture. A full time agent of 
the Agriculture Extension Service (AES), he is based in the university 
and is responsible for keeping the county agents informed and up-to-date 
on new developments in his special area. There is some research evidence 
that these extension specialists do indeed see their role primarily as that 
of one-way communicators of university research to the counties (Brown 
and Deekens, 1958) . Nevertheless, the linking task of this specialist is a 
sophisticated one. He must take research findings in raw form and pack- 
age them into pamphlets, programs, projects, lectures, training courses 
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and other forms which are readily digestible by the county agent and his 
farmer clients. Such a variety of tasks would in industry involve sue’, 
varied roles as research retrieval, engineering, production, packaging, 
advertising, and marketing. 

A similar linking role is played by the science reporter, who retrieves 
and interprets knowledge from a wide range of scientific sources, even 
if he specializes in one field, and draws forth items which appear to be of 
interest to the general public (Wood, 1962) . 

Of all conveyor types, the one most frequently cited and viewed as a 
classic is the county agent of the AES, who is most frequently viewed as 
a one-way communicator of new technical information from the state 
university to the farmer. Various studies of the “image” of the county 
agent indicate the prevalence of this limited conception (Abraham, 1963; 
Wilkening, 1958) . This view is not shared by die county agent, himself, 
however, and is not confirmed by researchers who have studied the role 
in depth (e.g., Stone, 1952; Wilkening, 1956). In fact, the county agent 
serves as communicator, teacher, consultant, demonstrator, helper, and 
community leader, culling information from a variety of sources and 
disseminating it in a variety of ways. 

When planners and policy makers in education discuss the need for 
more disseminator and diffusor roles in education (e.g., Clark and Hop- 
kins, 1966) they should be sensitive to this distinction between “con- 
veyor” and a more complex conception of linker. There is, nevertheless, 
a distinct logic to the simple concept and a distinct utility if it could be 
made to work in practice. The trouble with the concept may be in large 
part or e of “image.” The fact is that terms like “disseminator” or “con- 
veyor” sound to most people like “errand boy,” and “runner.” Znaniecki, 
for example, discussing the disseminator function, says: “. . . while im- 
portant socially (to develop support for scholars) , it is scientifically un- 
productive” (Znaniecki, 1940, page 150) . Halpin puts the matter bluntly : 

I can only writhe as I watch the fatuous and condescending attitude of 
both the scientist and educational practitioner toward prospective middle- 
men. Even the advocates of the middleman plan imply that the middle- 
man should serve as a type of editorial assistant, at a status level only 
, slightly above that of the average secretary and certainly below that of 
the research technician. (Halpin, 1962, p. 198) 

Such comments may well be valid in the main. There are some con- 
veyor-type linkers, however, who escape stigma altogether. In particular 
we can cite the by now well-established role of scientific expert or advisor. 
Perhaps beginning with the mobilization of brainpower in the Second 
World War, there has been increasing interest at the highest levels of 
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government for advice and presumably expert information from dis- 
tinguished scientists. In repeatedly answering this call, some of our most 
renowned scientists have, in effect, turned themselves into knowledge 
linkers of the conveyor type. Unfortunately, there have been no quantita- 
tive and thorough empirical studies of this role of scientific expert, al- 
though much has been written in a journalistic vein. Most writers focus 
on the question of the legitimate or proper role of the scientist in the 
policy-making and decision-making process. Many warn of the dangers 
of too much reliance on experts. For example, Moulin (1962) notes that 
experts are replacing public opinion as guiding forces in political decisions 
(hence possibly subverting democracy). Schilling (1962) and Michael 
(1966) warn that scientists may disguise personal values and partisan 
viewpoints in the form of “expert advice,” while Penders (1963) cautions 
us that expertise at the top, while indispensable, should only be used in 
conjunction with heavy local responsibility. On the other hand, some 
writers deplore the relative powerlessness of the scientist-expert. Spon- 
sler (1962) , for example, contrasts the influence of scientists in the Soviet 
Union and the United States: there they are “on top,” in significant policy 
roles, but here only “on tap,” and therefore functioning in a marginal 
and less-than-optimum capacity. On the other side of this argument, 
Leiserson (1965) says that as we move from “technical” to “policy” 
advice, the scientist’s role becomes less vital and this is as it should be to 
protect and maintain his status as an objective knowledge source. 

Another successful, if less exalted, linking role is found in some sectors 
of industrial R & D in the title of “systems engineer.” As this role is de- 
picted operating in the Bell Telephone Laboratories (Havelock and Benne, 
1967 ; Morton, 1964) , it allows basic researchers and development engi- 
neers to pursue their separate special interests without “interference” 
from management. The systems engineer looks over their shoulders, 
pulling out ideas and popping them in when it seems appropriate, but 
not disrupting their ongoing creative efforts. One might assume that such 
a person would be subjected to second class status as depicted by Halpin. 
In fact, however, he survives and prospers to the point where upper man- 
agement looks to this group for future leadership positions. 

To sum up, the conveyor concept of linkage is a very limited one but 
has wide-spread currency; it is what people usually think of when they 
think about special roles to disseminate knowledge. Very low valuation, 
by researchers and practitioners alike, suggests that it is a problem role 
under most circumstances. There are instances, however, where conveyor- 
type linkers are accorded high prestige and are able to operate with high 
effectiveness. 
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The consultant 

In its purest form the consultant role is not necessarily a knowledge 
linking role at all. The consultant is, rather, a facilitator, helper, objective 
observer, and specialist in how to diagnose needs, how to identify re- 
sources, and how to retrieve from expert sources. He tells “how” in 
contrast to the conveyor, who tells “what” (Havelock, 1967 ; Jung, 1967) . 
The underlying rationale for consultation is that only the client, himself 
(the user), can determine what is really useful for him. Therefore, when 
others come to his aid they should do so as collaborators, (Thelen, 1967) 
or encouragers (Bowman, 1959) . It is up to the consultee to take the 
initiative (Boehm, 1956) and when information is given, he is in a posi- 
tion to take it or leave it. Binderman (1959) notes that five characteris- 
tics distinguish consultation from education: first, the consultee initiates ; 
second, the relationship is temporary and specific ; third, the consultant is 
from a different professional discipline than the consultee; fourth, he is 
advisory only, having no responsibility for implementation; and fifth, he 
has no administrative relationship to the consultee. 

Consultation is often depicted as a second best procedure, a very pas- 
sive, impotent, almost bystander role (Fry, 1964; Huessy, 1966), but 
two relatively recent developments have added considerable depth to the 
concept. One of these has been “mental health consultation,” 1 first ad- 
vanced by Coleman and later refined by Gerald Caplan (Berlin, 1964). 
From the psychiatric interview came the insight that “help” really starts 
with “help me to understand myself’ and “help me to define for myself 
why I need help and what help I need.” This concept has been generalized 
from the mental health professions to all forms of helping and applies 
equally to knowledge linking. When someone comes to someone else for 
“advice,” what they need first and foremost is an understanding of what 
their problem is and how they are reacting to it. The consultant, there- 
fore, should allow the consultee to tell his story, not so the consultant 
may be informed, but so the consultee may be informed. This type of 
relationship calls for restraint and a non-directive stance by the con- 
sultant and a withholding of advice, expert information, and a minim um 
of programming for the consultee. 

A somewhat different concept of consultation has been developed over 
the last twenty years by the staff of the National Training Laboratory 
under the label of “change agent” (Lippitt, et al., 1958) . The “change 
agent” consultant, like the mental health consultant, emphasizes the need 

1 This should not be confused with psychotherapy, psychotherapeutic counseling 
or other varieties of treatment for mental illness, in spite of some similarities in his- 
torical origin and assumptions. 
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for client self-diagnosis and problem definition, but the change agent is 
flexible in what he gives. He may assist in the diagnosis by showing the 
client how to conduct a self-survey (Selltiz and Wormser, 1949), or by 
administering a self-survey to the client (Mann, 1950, 1962; Mann and 
Neff, 1961) . He may help the client develop skills in problem formulation 
and problem solving and he may make the client aware of various change 
strategies. The change agent consultant is, therefore, an active participant 
and collaborator and a conveyor of knowledge about the process of 
change itself. 

Both of these developments in consultation i.e., the mental health 
consultant and the change agent consultant, have come a long way in their 
twenty-year history, each developing as a distinct profession with its own 
rules and institutions. Most recently, however, there are signs of a merg- 
ing of, or at least a mutual learning between, the two movements, the 
change agent group becoming more clinically sophisticated and the men- 
tal health consultation group more concerned with active helping and 
collaborating with the client (Chin and Benns, 1968) . 

While such refinements in the concept of consultation are now widely 
understood and accepted, the reader should be cautioned that the actual 
term “consultant” is still used very loosely to describe any type of advice- 
giver or expert, including the “conveyor” type discussed earlier (Fair- 
weather, 1967). Many writers use the term to describe someone who is 
peripheral to the mainstream of decision-making, either because his 
expertise is not recognized or valued, 2 or because he needs to retain the 
onlooker’s objectivity. 3 The term is used by Schein and Bennis (1965) 
merely to distinguish the outside change agent (the “consultant model”) 
from various other change agent roles which operate within the client 
system. 

We may be able to gain some perspective on the concepts of “conveyor” 
and “consultant,” as used here, by a comparison of some of their attri- 
butes. Table 2 illustrates some important advantages of the consultant’s 
role definition. However we do not wish to stress the value of the consul- 
tant over the conveyor as this table may imply. The emphasis should be 
placed on the unique contribution which each type of role may play in a 
total program of knowledge dissemination and utilization. The two roles 
may be used effectively in a coordinated development program, with the 
consultant type preparing the client or client system, building a readiness 

2 Early use of mathematicians in industry (Fry, 1964) . 

3 Peter summarizes the viewpoint of social scientists about their action role: 
“observe and do research but remain essentially aloof from action programs” (Foun- 
dation for Research on Human Behavior, 1966, p. 374) . 
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Table 2 

FIVE DIFFICULTIES WITH THE LINKAGE ROLE: A 
COMPARISON OF TWO APPROACHES 



PROBLEM 


CONVEYOR 


CONSULTANT 


(1) Marginality 


Because he is not "one of us" he 
may be excluded from inner circles 
of both research and practice 
where most sophisticated and 
appropriate formulations of 
knowledge and problems 
may reside. 


Doesn't need to belong to "inner 
circle" because he doesn't need 
this special knowledge. 


(2) Two Master* 


If he is seen as serving special 
interests of one client, the other 
client may not be open to him. 
The client may see his information 
as biased or illegitimate in 
one way or another. 


Does not put himself in the posi- 
tion of "selling" anything. 


(3) Pain 

Remoteness 


Must know the nature of the need 
in order to bring relevant 
knowledge to bear. 


Makes sure the client initiates 
action. 


<4) Super-expertise 


Over-strains the capacity of 
the linker. 

Over-isolates researchers. 

Builds dependency and problem- 
solving incapacity in client. 


Required to have only general 
knowledge of retrieving informa- 
tion, deriving solutions, and diag- 
nosing problems; therefore avoids 
being seen as a "walking encyclo- 
pedia." 


(5) Structural 
Redundancy 
(channel 
inefficiency) 


He is "on-line." If he pulls out, 
he is in danger of disrupting flow, 
may not leave client with 
adequate skills. If he stays 
"on-line" manpower is lost and an 
additional potential source of 
error is created in the system. 


Never puts himself "on-line"; 
therefore, he doesn't constitute a 
direct block. 



to change and an openness to outside expert knowledge and an under- 
standing of how and when to use such knowledge. Glaser (1967) , for ex- 
ample, in a carefully controlled field experiment, found that psychologi- 
cal consultation developed greater client receptivity to . . research, dem- 
onstration and innovations developed by others.” 

On the other hand, the conveyor is needed to provide crucial technical 
information at the time when the client is ready for it. Wilkening (1956) 
found that the county agent was relatively ineffective as an introducer 
of new ideas, but when it came to translating innovations into practice 
and adapting them to personal use, he was crucial. As we have mentioned 
previously, detailed studies of the effective county agent show him taking 
a variety of roles at different stages in the adoption process (Penders, 
1963; Stone, 1952) — sometimes encouraging and assisting the client with 
self diagnosis, sometimes providing new information, sometimes training 
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or retraining, sometimes providing encouragement and reinforcement. 

There are a number of other roles akin to that of the “consultant” in 
which the involvement is not one of directly providing knowledge but 
rather facilitating the process. Reiff and Reissman (1964) discuss the role 
of “expeditor” as an ideal role for the indigenous non-professional. The 
expeditor is one who “sees to it that service is given” to the user. Such a 
person would be able to identify with client needs and concerns and yet 
be influential and knowledgeable about the resources of the serving sys- 
tem. Implicit in the expeditor’s role is the idea that partisanship (on 
behalf of the client) is a useful and in most cases necessary stance for 
the linker; this represents a deviation from the consultant concept. We 
will return to this question later in discussing the role of “defender.” 

At the opposite extreme from the expeditor is the “mediator,” one who 
is officially and legitimately objective. This notion of linkage is thor- 
oughly legal. It assumes that knowledge producers, conveyors, and clients 
are all basically partisans and potential adversaries. Thus, relations be- 
tween doctors and patients, sellers and buyers, writers and readers, and 
teachers and students are regulated by specific norms and rules which 
are codified in our legal system. This system, in turn, is administered by 
an officially “objective” group, the judiciary. Probably the role of the 
judiciary has been most prominent in the field of psychiatry (Tershako- 
vec, 1964) . The marginal status of psychiatry as a medical science leads 
to considerable conflict and confusion between psychiatry and the public 
on such critical questions as “What is mental illness?”, “What is the 
proper treatment for mental illness?”, and “What is the difference be- 
tween mental illness and criminality?”. Decisions on these questions are 
not made by the “experts” but by the judges after listening to experts and 
reflecting on the needs of society. The utility and appropriateness of this 
sort of middleman may be disputed in specific cases, but it is probably 
an indispensible last resort when problems of linkage have turned into 
conflicts. 4 

The trainer 

There is probably a need to distinguish the specialized role of “trainer” 
or “teacher” from both conveyors and consultants despite some overlap 
in meanings. The trainer works on the assumption that underlies much 
of formal education, namely that a body of knowledge can be conveyed 
and stored for future use in an extended, intensive learning experience, 



4 Many readers may see this inclusion of judicial and legal roles within the link- 
ing role concept as rather muddy. It must be agreed that such persons are not pri- 
marily knowledge linkers, but only serve this role on occasion. 
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usually in a specialized learning environment, e.g., a school, university, 
summer camp, etc. The trainer is an expert who is capable of conveying 
large quantities of knowledge and/ or complex skills but he does not 
typically convey this knowledge to people who are in the work setting. 
In contrast to the conveyor” he tries to inculcate new knowledge prior 
to the time the practitioner enters the work setting. Thus the farmer’s 
son may attend the agricultural college to be taught by professors of 
agriculture (trainer). Later, back on the farm, he may learn from the 
county agent (conveyor). 

The trainer is also distinguishable from the conveyor in having a 
greater control over the learning environment. Typically, he has some 
position of authority over the learner (as teacher to student) , and may 
use various coercive and/ or reinforcing techniques which neither the 
consultant nor the conveyor may employ (grades, diplomas, certificates, 
letters of recommendation, etc.) 

This review doss not include any extensive consideration of the litera- 
ture on teaching or the role of the teacher or trainer, and no literature is 
cited here. Although it is important and deserves a place in any taxonomy 
of linking types it is a role thoroughly understood by most readers and 
effectively described in other sources. 

For knowledge utilization among practitioners in all fields the most 
vital trainer role is probably the professor of practice. Particularly since 
the decline of the apprenticeship system, our culture has relied almost 
exclusively on the professor of practice in the university to pass on or 
inculcate an understanding of a profession in the next generation of 
practitioners. Because of this strategic role in the socialization of the 
practitioner, his attitudes, training, skills, and orientation toward change 
will have a major impact on the progressiveness and innovativeness of 
an entire profession. 

The chief limitation of the trainer role is the lack of continuing contact 
with the practitioner, especially contact in the field setting. The trainer 
prepares the new practitioner and sends him out into the world as if he 
were somehow a finished product. Perhaps he will need occasional servic- 
ing or recharging in summer institutes or refresher courses but essen- 
tially the trainer relinquishes any linking function after a designated 
training period is over. 

The leader 

Both the conveyor and the consultant are typically outsiders as far 
as the receiver-user is concerned. They are not likely to be linked to him 
in a formal organizational sense, nor are they likely to be related in a refer- 
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ence group sense of being “one of us.” There are, on the other hand, a 
number of roles which create effective linkage through power or influence 
within the receiver’s own group. We discuss these various role types under 
the designation “leader.” 

To begin with, there is good evidence that formally constituted leaders 
(administrators, supervisors, directors, presidents) do have a major ef- 
fect on utilization of new ideas. Carlson (1954) has shown this with 
respect to school system superintendents, as has Richard (1965). Just 
how the administrator brings about utilization, and what sort of role he 
plays in the process, is more problematic, however. Some authors, e.g., 
Ashby (1962) , seem f,o suggest that he is sort of a channel through which 
all information comes to the users. Others indicate that administrators 
function as “facilitators” or “supporters” of the user’s efforts to retrieve 
and utilize new ideas. 6 

A concept related to formal leadership, but used more typically in the 
area of planned change and diffusion, is that of “gatekeeper.” This term 
was first introduced by Lewin (1952, 1963) in describing housewives as 
the focal persons through whom influence on household eating habits had 
to be channeled. Many receiver systems may be so organized that there 
is a distinct “gate” (specific set of rules, norms, etc.) which must be 
passed to get free access to a group of receivers. In bureaucratic organiza- 
tions this “gate” may be controlled by the “boss,” the formally designated 
leader, or it may be controlled by some other officially designated person, 
e.g., editor. 

The “gatekeeper” concept is significant in that it reminds us to note 
the channels and barriers which represent the client-user system and the 
access routes to it. The gatekeeper is the one who holds the strategic posi- 
tion. The gatekeeper can be the formal leader, but organization charts 
and official power may be misleading. In most parts of the world, for 
example, the oldest male is the head of the household and is accorded 
the highest prestige. Nevertheless, it may be the female who controls 
access to those critical areas of personal life which are of most concern 
to the development worker, as, for example, in the dissemination of birth 
control information, sanitation procedures, food preparations, etc. Cama 
(1963) , for example, notes the great potential of utilizing women in de- 
velopment programs for these reasons. 

The formal leader and the gatekeeper (strategic role holder) are both 
to be distinguished from the opinion leader (Katz, 1957) . There is a large 
body of literature supporting the view that the vast majority of those 

B Chester et ai. (1963), on the role of the school principal, and Carey (1961) on 
the role of the university president in the development of evening colleges. 



